-- Logs begin at Thu 2022-06-30 11:42:04 UTC, end at Thu 2022-06-30 12:50:59 UTC. -- Jun 30 12:24:17.005352 dv-cinder-846146-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 30 12:24:17.014472 dv-cinder-846146-5-iscsi devstack@n-api.service[103134]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 30 12:24:17.016473 dv-cinder-846146-5-iscsi devstack@n-api.service[103134]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 30 12:24:17 2022] *** Jun 30 12:24:17.016473 dv-cinder-846146-5-iscsi devstack@n-api.service[103134]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 30 12:24:17.016473 dv-cinder-846146-5-iscsi devstack@n-api.service[103134]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 30 12:24:17.016473 dv-cinder-846146-5-iscsi devstack@n-api.service[103134]: nodename: dv-cinder-846146-5-iscsi Jun 30 12:24:17.016473 dv-cinder-846146-5-iscsi devstack@n-api.service[103134]: machine: x86_64 Jun 30 12:24:17.016473 dv-cinder-846146-5-iscsi devstack@n-api.service[103134]: clock source: unix Jun 30 12:24:17.016473 dv-cinder-846146-5-iscsi devstack@n-api.service[103134]: pcre jit disabled Jun 30 12:24:17.016473 dv-cinder-846146-5-iscsi devstack@n-api.service[103134]: detected number of CPU cores: 4 Jun 30 12:24:17.016473 dv-cinder-846146-5-iscsi devstack@n-api.service[103134]: current working directory: / Jun 30 12:24:17.016473 dv-cinder-846146-5-iscsi devstack@n-api.service[103134]: detected binary path: /usr/bin/uwsgi-core Jun 30 12:24:17.016473 dv-cinder-846146-5-iscsi devstack@n-api.service[103134]: your processes number limit is 47680 Jun 30 12:24:17.016473 dv-cinder-846146-5-iscsi devstack@n-api.service[103134]: your memory page size is 4096 bytes Jun 30 12:24:17.016473 dv-cinder-846146-5-iscsi devstack@n-api.service[103134]: detected max file descriptor number: 2048 Jun 30 12:24:17.016473 dv-cinder-846146-5-iscsi devstack@n-api.service[103134]: lock engine: pthread robust mutexes Jun 30 12:24:17.017428 dv-cinder-846146-5-iscsi devstack@n-api.service[103134]: thunder lock: enabled Jun 30 12:24:17.017428 dv-cinder-846146-5-iscsi devstack@n-api.service[103134]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 30 12:24:17.017428 dv-cinder-846146-5-iscsi devstack@n-api.service[103134]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 30 12:24:17.060685 dv-cinder-846146-5-iscsi devstack@n-api.service[103134]: Python main interpreter initialized at 0x55df7e4799c0 Jun 30 12:24:17.060685 dv-cinder-846146-5-iscsi devstack@n-api.service[103134]: python threads support enabled Jun 30 12:24:17.060685 dv-cinder-846146-5-iscsi devstack@n-api.service[103134]: your server socket listen backlog is limited to 100 connections Jun 30 12:24:17.060685 dv-cinder-846146-5-iscsi devstack@n-api.service[103134]: your mercy for graceful operations on workers is 90 seconds Jun 30 12:24:17.061402 dv-cinder-846146-5-iscsi devstack@n-api.service[103134]: mapped 403077 bytes (393 KB) for 2 cores Jun 30 12:24:17.061402 dv-cinder-846146-5-iscsi devstack@n-api.service[103134]: *** Operational MODE: preforking *** Jun 30 12:24:17.061706 dv-cinder-846146-5-iscsi devstack@n-api.service[103134]: *** uWSGI is running in multiple interpreter mode *** Jun 30 12:24:17.061706 dv-cinder-846146-5-iscsi devstack@n-api.service[103134]: spawned uWSGI master process (pid: 103134) Jun 30 12:24:17.061908 dv-cinder-846146-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 30 12:24:17.064130 dv-cinder-846146-5-iscsi devstack@n-api.service[103134]: spawned uWSGI worker 1 (pid: 103135, cores: 1) Jun 30 12:24:17.064130 dv-cinder-846146-5-iscsi devstack@n-api.service[103134]: spawned uWSGI worker 2 (pid: 103136, cores: 1) Jun 30 12:24:17.064130 dv-cinder-846146-5-iscsi devstack@n-api.service[103134]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 30 12:24:17.734283 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 30 12:24:17.741386 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 30 12:24:18.851877 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 30 12:24:18.851877 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: from cryptography.utils import int_from_bytes Jun 30 12:24:18.852607 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 30 12:24:18.852607 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: from cryptography.utils import int_from_bytes Jun 30 12:24:18.854794 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 30 12:24:18.854794 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: from cryptography.utils import int_from_bytes Jun 30 12:24:18.855279 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 30 12:24:18.855279 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: from cryptography.utils import int_from_bytes Jun 30 12:24:21.404402 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 30 12:24:21.405036 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 30 12:24:21.405330 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 30 12:24:21.405693 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 30 12:24:21.405952 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 30 12:24:21.406340 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.406663 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.406986 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.407340 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.407906 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.408251 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.408815 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.409147 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.409479 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.409744 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.410063 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.411529 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846146-5-iscsi {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.411529 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.411529 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.411529 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.411978 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.411978 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.412211 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.412512 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.413032 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.414768 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.414768 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.415004 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 30 12:24:21.415415 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.415546 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 30 12:24:21.415682 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.415809 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 30 12:24:21.415930 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.416034 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 30 12:24:21.416150 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.416268 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 30 12:24:21.416268 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.416512 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.416683 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.416805 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.416927 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.416927 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.418987 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.418987 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.419226 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.419226 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.419464 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846146-5-iscsi {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.419593 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.419714 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.419845 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.420055 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.420195 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.420317 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.420435 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.420562 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.420701 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.420836 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.420964 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846146-5-iscsi {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.421086 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.421205 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.421323 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.421441 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.421568 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.421695 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.421814 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.421943 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.422063 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.422183 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.422314 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.422441 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.424392 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.424535 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.424696 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.424696 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.424942 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.425079 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.425199 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.425326 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.425446 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.425587 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.425721 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.425847 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.425967 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.426100 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.426221 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.426347 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.426475 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.426596 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.426720 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.426931 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.427063 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.427063 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.427312 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.427434 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.427568 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.427692 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846146-5-iscsi {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.427819 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.427941 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.427941 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.428323 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.428460 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.428596 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.428850 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.428850 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.429098 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.429232 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.429353 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.429479 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.429479 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.429721 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.429842 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.429960 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.430172 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.430172 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.430400 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.430530 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.430658 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.430778 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.430980 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.431108 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.431229 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.431358 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.431485 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.431606 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.431724 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.431843 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.431978 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.432100 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.432221 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.432340 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.432458 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.432577 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.432577 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.432827 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.432957 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.432957 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.433188 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.57 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.433315 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.433446 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.57 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.433592 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.433742 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.433871 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.433984 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.434103 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.434207 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.434207 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.434413 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.434534 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.434660 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.434789 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.434915 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.435044 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.435162 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.435368 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.435546 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.435692 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.436331 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.436509 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.436677 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.436806 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.436943 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.437077 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.437236 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.437374 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.437576 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.437754 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.437901 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.438026 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.438155 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.438276 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.438494 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.438680 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.438903 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.57 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.439095 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.439239 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.57 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.439403 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.439534 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.439762 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.439952 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.440088 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.440233 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.440362 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.440484 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.440682 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.440829 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.441028 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.441218 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.441364 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.441496 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.441639 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.441771 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.441892 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.442022 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.442182 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.442318 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.442488 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.442626 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.442791 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.442921 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.443041 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.443181 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.443311 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.443440 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.443637 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.443829 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.443963 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.444093 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.444233 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.444366 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.444514 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.444689 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.444930 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.445122 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.445271 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.445398 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.445526 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.445657 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.445779 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.445897 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.446113 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.446304 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.446438 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.446562 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.446683 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.446817 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.447012 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.447190 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.447341 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.447473 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.447607 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.447740 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.447861 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.447981 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.448177 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.448302 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.448492 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.448667 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.448791 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.448912 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.449114 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.449272 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.449480 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.449625 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.449761 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.449897 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.450082 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.450209 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.450387 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.450531 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.450661 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.450781 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.450979 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.451105 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.451282 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.451418 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.451598 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.451732 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.451916 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.452050 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.452252 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.452380 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.452500 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.452619 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.452818 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.452941 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.453129 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.453256 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.453434 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.453559 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.453724 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.453846 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.454045 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.454180 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.454354 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.454487 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.454657 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.454783 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.454966 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.455094 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.455267 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.455394 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.455575 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.455715 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.455843 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.455954 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.456166 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.456334 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.456458 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.456586 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.456798 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.456938 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.457124 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.457251 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.457432 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.457572 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.457744 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.457872 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.458047 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.458173 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.458366 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:24:21.458501 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.458689 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.458824 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.459008 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.459134 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.459314 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.459444 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.459628 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.459755 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.459960 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.460085 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.460282 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.460411 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.460603 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.460791 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.460920 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.461045 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.461242 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.461369 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.461568 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.461704 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.461887 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.462015 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.462202 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.462332 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.462491 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.462613 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.462801 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.462933 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.463111 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.463244 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.463430 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.463553 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.463743 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.463866 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.464053 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.464176 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.464369 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.464491 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.464695 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.464838 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.465031 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.465169 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.465341 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.465464 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.465649 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.465781 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.465961 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.466078 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.466297 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.466419 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.466611 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.466750 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.466924 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.467049 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.467233 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.467356 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.467546 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.467680 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.467854 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.467984 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.468161 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.468285 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.468466 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.468596 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.468797 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.468921 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.469099 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.469224 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.469400 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.469525 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.469704 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.469828 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.470009 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.470133 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.470329 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.470461 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.470658 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.470789 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.470962 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.471085 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.471291 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.471417 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.471595 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.471719 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.471905 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.472042 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.472214 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.472343 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.472523 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.472669 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.472852 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.472988 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.473164 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.473286 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.473473 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.473595 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.473777 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.473918 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.474081 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.474203 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.474388 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.474513 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.474688 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.474888 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.475012 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.475139 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.475266 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.475387 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.475589 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.475723 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.475898 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.476027 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.476206 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.476331 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.476513 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.476662 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.476854 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.476989 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.477164 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.477295 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.477475 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.477598 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.477785 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.477907 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.478091 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.478214 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.478404 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.478528 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.478718 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.478841 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.479024 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.479147 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.479346 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.479469 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.479658 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.479780 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.479963 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.480094 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.480268 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.480390 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.480733 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.480869 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.480989 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.481129 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.481252 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.481373 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.481525 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.481648 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.481835 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.481968 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.482135 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.482259 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.482442 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.482573 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.482742 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.482875 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.483042 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.483177 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.483342 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.483473 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.483662 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.483787 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.483968 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.484092 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.484270 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.484392 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.484572 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.484729 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.484894 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.485026 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.485237 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.485362 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.485540 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.485674 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.485848 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.486062 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.486187 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.486318 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.486448 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.486598 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.486726 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.486847 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.487034 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.487169 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.487337 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.487460 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.487642 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.487766 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.487946 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.488078 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.488250 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.488383 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.488555 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.488720 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.488906 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.489048 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.489215 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.489354 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.489516 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.489638 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.489818 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.489954 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.490123 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.490247 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.490433 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.490554 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.490750 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.490886 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.491053 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.491176 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.491366 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.491491 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.491702 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.491833 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.492033 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.492155 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.492345 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.492467 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.492679 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.492805 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.492989 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.493110 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.493299 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.493423 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.493604 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.493734 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.493911 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.494034 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.494218 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.494350 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.494528 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.494658 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.494844 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.494966 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.495152 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.495284 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.495466 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.495597 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.495774 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.495897 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.496121 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.496333 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.496512 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.496667 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.496778 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.496881 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.497091 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.497230 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.497424 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.497548 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.497743 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.497944 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.498143 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.498339 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.498473 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.498602 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.498729 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.498850 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.498982 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.499109 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.499264 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.499388 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.499570 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.499693 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.499879 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.500002 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.500179 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.500301 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.500494 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.500615 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.500841 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.501132 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.501263 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.501464 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.501672 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.501803 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.502079 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.502202 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.502384 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.502538 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.502698 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.502851 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.503027 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.503172 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.503362 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.503674 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.503797 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.503998 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.504202 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.504327 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.504594 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.504743 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.504930 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.505243 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.505368 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.505550 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.505827 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.505951 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.506152 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.506334 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.506467 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.506761 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.506933 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.507107 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.507289 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.507419 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.507717 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.507848 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.508024 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.508148 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.508329 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.508454 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.508688 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.508815 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.509115 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.509238 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.509445 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.509756 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.509881 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.510079 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.510311 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.510434 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.510673 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.510797 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.511048 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.511186 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.511310 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.511434 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.511610 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.511789 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.512042 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.512185 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.512351 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.512680 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.512807 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.513009 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.513131 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.513329 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.513452 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.513636 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.513760 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.513955 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.514078 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.514276 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.514400 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.514586 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.514715 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.514901 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.515021 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.515210 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.515333 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.515521 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.515653 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.515835 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.515959 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.516150 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.516285 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.516463 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.516586 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.516781 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.516902 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.517100 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.517241 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.517411 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.517535 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.517723 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.517846 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.518048 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.518185 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.518362 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.518674 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.518798 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.518980 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.519114 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.519286 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.519422 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.519598 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.519729 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.519918 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.520053 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.520235 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.520499 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.520664 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.520863 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.520986 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.521199 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.521340 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.521501 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.521763 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.521889 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.522082 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.522212 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.522392 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.522517 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.522699 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.522831 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.523013 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.523137 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.523321 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.523458 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.523636 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.523785 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.523938 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.524036 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.524249 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.524354 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.524553 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.524663 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.524890 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.525043 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.525195 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.525301 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.525500 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.525586 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.525810 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.525902 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.526114 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.526210 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.526420 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.526507 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.526725 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.526957 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.527051 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.527380 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.527586 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.527676 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.527977 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.528122 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.528292 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.528457 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.528609 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.528789 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.528932 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.529095 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.529293 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.529498 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.529630 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.529802 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.530058 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.530194 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.530443 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.530676 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.530807 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.531029 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.531264 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.531435 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.531582 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.531714 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.531809 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.532026 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.532220 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.532352 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.532680 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.532806 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.532991 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.533294 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.533380 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.533606 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.533816 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.533900 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.534205 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.534335 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.534516 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.534825 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.534915 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.535133 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.535373 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.535465 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.535791 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.535882 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.536580 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.536699 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.536771 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.536921 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.537038 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.537289 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.537507 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.537594 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.537887 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.538089 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.538202 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.538464 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.538549 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.538790 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.538873 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.539105 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.539190 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.539408 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.539502 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.539725 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.539810 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.540032 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.540117 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.540337 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.540422 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.540674 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.540820 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.540992 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.541120 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.541300 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.541447 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.541616 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.541756 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.541925 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.542052 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.542245 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.542368 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.542554 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.542687 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.542861 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.543067 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.543285 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.543427 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.543612 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.543746 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.543927 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.544057 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.544233 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.544357 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.544560 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.544741 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.544901 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.545024 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.545207 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.545337 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.545512 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.545643 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.545817 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.545941 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.546223 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.546346 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.546535 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.546659 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.546851 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.546975 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.547159 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.547282 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.547465 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.547590 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.547771 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.547893 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.548077 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.548201 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.548381 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.548510 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.548720 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.548846 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.549029 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.549153 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.549336 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.549460 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.549644 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.549781 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.549945 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.550078 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.550245 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.550375 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.550548 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.550673 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.550851 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.550984 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.551173 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.551297 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.551483 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.551606 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.551787 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.551920 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.552094 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.552220 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.552394 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.552518 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.552744 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.552942 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.553074 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.553351 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.553505 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.553663 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.553974 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.554137 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.554270 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.554528 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.554657 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.554850 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.554987 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.555174 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.555297 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.555483 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.555613 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.555809 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.556043 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.556168 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.556446 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.556647 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.556784 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.557075 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.557210 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.557385 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.557502 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.557693 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.557824 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.558004 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.558137 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.558311 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.558434 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.558686 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.558812 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.559088 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.559249 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.559422 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.559611 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.559733 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.559929 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.560067 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.560243 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.560376 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.560553 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.560706 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.561260 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.561443 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.561569 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.561770 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.561937 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.562181 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.562346 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.562647 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.562808 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.562915 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.563108 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.563229 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.563415 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.563727 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.563852 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.564032 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.564341 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.564464 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.564782 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.564910 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.565098 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.565221 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.565405 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.565532 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.565718 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.565844 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.566030 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.566152 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.566343 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.566465 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.566653 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.566777 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.566957 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.567080 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.567284 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.567414 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.567597 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.567721 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.567905 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.568028 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.568217 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.568349 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.568525 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.568677 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.568858 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.568992 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.569166 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.569299 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.569502 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.569626 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.569812 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.569934 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.570117 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.570249 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.570489 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.570620 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.570820 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.570944 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.571128 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.571252 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.571456 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.571580 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.571846 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.571967 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.572154 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.572278 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.572468 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.572589 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.572896 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.573019 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.573208 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.573341 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.573518 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.573642 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.573823 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.573946 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.574127 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.574325 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.574572 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.574694 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.574881 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.575001 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.575193 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.575325 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.575500 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.575625 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.575805 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.575937 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.576131 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.576255 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.576440 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.576564 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.576782 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.577018 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.577144 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.577400 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.577726 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.577937 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.578069 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.578245 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.578369 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.578559 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.578758 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.578979 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.579103 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.579293 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.579417 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.579691 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.579815 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.580018 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.580329 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.580461 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.580651 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.580884 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.581008 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.581256 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.581430 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.581555 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.581873 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.581997 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.582180 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.582472 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.582600 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.582787 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.582962 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.583087 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.583388 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.583510 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.583693 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.583881 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.584014 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.584311 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.584442 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.584648 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.584844 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.584980 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.585281 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.585413 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.585605 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.586018 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.586150 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.586280 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.586460 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.586584 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.586825 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.586998 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.587121 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.587421 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.587545 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.587765 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.588107 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.588239 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.588435 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.588782 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.588913 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.589123 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.589384 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.589517 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.589794 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.589923 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.590131 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.590261 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.590451 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.590720 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.590853 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.590977 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.591106 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.591228 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.591377 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.591501 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.591682 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.591806 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.591997 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.592121 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.592304 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.592428 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.592610 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.592786 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.592941 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.593065 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.593256 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.593393 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.593562 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.593685 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.593867 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.593989 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.594170 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.594301 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.594490 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.594613 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.594793 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.594916 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.595116 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.595251 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.595507 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.595629 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.595831 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.595964 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.596142 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.596276 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.596449 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.596574 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.596823 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.596948 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.597129 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.597255 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.597437 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.597568 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.597743 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.597869 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.598088 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.598227 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.598396 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.598525 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.598721 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.598844 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.599047 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.599170 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.599369 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.599494 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.599687 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.599809 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.600005 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.600129 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.600325 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.600449 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.600660 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.600801 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.600983 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.601110 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.601303 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.601430 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.601613 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.601743 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.601927 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.602112 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.602235 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.602551 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.602675 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.603117 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.603242 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.603449 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.603770 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.603896 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.604083 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.604278 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.604402 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.604725 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.604864 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.605044 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.605359 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.605663 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.606002 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.606163 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.606296 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.606463 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.606717 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.606862 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.606985 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.606985 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.607222 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.607349 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.607631 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.607758 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.607952 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.608181 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.608304 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.608580 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.608833 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.608954 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.609276 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.609395 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.609605 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.609724 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.609915 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.610067 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.610230 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.610389 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.610544 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.610737 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.610863 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.611067 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.611191 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.611399 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.611532 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.611738 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.611862 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.612052 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.612174 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.612365 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.612499 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.612699 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.612839 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.613014 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.613138 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.613330 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.613469 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.613657 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.613878 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.614002 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.614302 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.614475 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.614599 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.614916 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.615046 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.615232 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.615454 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.615753 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.615885 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.616072 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.616197 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.616394 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.616515 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.616751 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.616946 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.617071 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.617388 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.617708 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.617930 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.618063 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.618337 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.618452 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.618643 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.618768 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.618955 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.619087 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.619270 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.619571 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.619693 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.619896 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.620177 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.620302 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.620499 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.620621 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.620845 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.620977 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.621198 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.621325 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.621730 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.621883 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.622082 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.622405 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.622531 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.622731 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.622947 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.623070 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.623364 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.623498 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.623673 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.623997 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.624127 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.624306 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.624586 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.624753 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.624940 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.625153 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.625277 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.625543 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.625697 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.625851 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.626162 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.626297 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.626473 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.626772 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.626905 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.627079 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.627376 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.627504 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.627701 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.627920 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.628053 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.628300 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.628423 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.628603 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.628935 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.629180 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.629307 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.629530 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.629653 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.629835 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.630058 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.630192 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.630433 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.630591 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.630724 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.631147 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.631279 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.631414 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.631536 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.631656 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.631776 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.631956 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.632088 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.632268 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.632400 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.632648 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.632775 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.632971 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.633101 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.633281 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.633415 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.633588 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.633713 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.633908 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.634041 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.634219 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.634344 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.634542 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.634667 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.634856 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.634990 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.635166 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.635385 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.635509 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.635706 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.635836 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.636196 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.636440 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.636565 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.636971 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.637100 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.637300 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.637425 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.637625 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.637771 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.637958 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.638112 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.638271 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.638433 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.638564 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.638746 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.638870 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.639057 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.639197 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.639384 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.639508 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.639696 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.639854 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.640010 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.640264 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.640392 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.640575 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.640720 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.640924 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.641057 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.641237 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.641361 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.641564 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.641776 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.641900 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.642132 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.642265 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.642455 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.642572 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.642765 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.642888 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.643074 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.643193 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.643384 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.643517 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.643698 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.643834 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.644024 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.644146 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.644334 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.644458 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.644653 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.644792 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.644979 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.645104 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.645292 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.645417 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.645596 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.645728 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.645901 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.646025 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.646205 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.646328 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.646513 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.646645 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.646816 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.646940 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.647126 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.647256 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.647429 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.647542 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.647735 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.647845 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.648047 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.648171 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.648353 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.648477 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.648682 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.648802 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.648996 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.649118 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.649307 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.649433 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.649614 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.649738 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.649920 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.650053 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.650225 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.650363 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.650538 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.650662 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.650842 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.650977 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.651151 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.651275 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.651455 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.651578 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.651764 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.651898 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.652067 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.652190 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.652431 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.652818 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.652936 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.653147 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.653273 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.653456 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.653589 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.653763 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.653930 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.654080 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.654204 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.654388 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.654511 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.654692 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.654824 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.654997 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.655129 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.655305 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.655427 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.655608 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.655740 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.655915 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.656040 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.656222 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.656555 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.656724 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.656894 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.657198 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.657344 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.657503 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.657757 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.657894 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.658098 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.658229 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.658400 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.658530 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.658710 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.658843 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.659020 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.659153 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.659325 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.659460 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.659631 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.659769 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.659936 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.660060 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.660241 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.660367 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.660545 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.660718 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.660879 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.661010 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.661192 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.661324 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.661507 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.661632 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.661816 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.661940 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.662128 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.662261 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.662437 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.662561 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.662745 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.662868 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.663050 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.663172 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.663360 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.663494 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.663777 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.663907 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.664096 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.664232 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.664434 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.664572 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.664772 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.664897 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.665086 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.665222 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.665399 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.665522 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.665709 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.665832 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.666020 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.666152 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.666332 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.666457 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.666638 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.666762 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.666944 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.667077 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.667261 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.667392 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.667588 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.667760 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.668031 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.668304 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.668436 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.668643 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.668770 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.669035 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.669172 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.669369 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.669494 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.669684 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.669810 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.670014 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.670237 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.670361 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.670563 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.670696 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.670892 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.671024 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.671210 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.671335 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.671525 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.671657 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.671851 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.671983 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.672166 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.672290 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.672479 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.672602 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.672833 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.672971 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.673167 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.673290 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.673492 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.673615 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.673803 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.673930 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.674146 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.674270 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.674524 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.674750 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.674885 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.675092 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.675336 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.675461 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.675629 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 30 12:24:21.675805 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.676125 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.676434 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.676814 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.677377 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.677950 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.678303 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.678618 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.678928 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.679508 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.680082 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.680413 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.680756 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.681072 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.681382 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.681692 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.682009 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.682317 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.682627 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.682935 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.683243 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.683600 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.683952 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.684425 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.684780 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.685134 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.685599 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.686305 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.686618 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.686944 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.687270 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.687588 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.687899 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.688235 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.688548 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.688887 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.689206 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.689520 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.689831 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.690144 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.690474 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.690798 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.691107 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.691431 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.691900 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.692224 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.692541 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.692875 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.693206 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.693518 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.693828 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.694143 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.694452 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.694763 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.695085 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.695398 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.695727 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.696069 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.696465 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.696832 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.697165 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.697513 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.697826 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.698169 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.698499 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.698815 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.699150 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.699935 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:24:21.700189 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 30 12:24:21.834828 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: INFO dbcounter [None req-ccd3e33b-afb1-457e-9aa0-739ecb34238b None None] Registered counter for database nova_api Jun 30 12:24:21.857749 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG oslo_db.sqlalchemy.engines [None req-ccd3e33b-afb1-457e-9aa0-739ecb34238b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103136) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 12:24:21.865100 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG dbcounter [-] [103136] Writer thread running {{(pid=103136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 12:24:21.874073 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: INFO dbcounter [None req-83d07d05-c8d0-4401-8ddd-cbc12c9fe332 None None] Registered counter for database nova_api Jun 30 12:24:21.894738 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG oslo_db.sqlalchemy.engines [None req-83d07d05-c8d0-4401-8ddd-cbc12c9fe332 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103135) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 12:24:21.901331 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG dbcounter [-] [103135] Writer thread running {{(pid=103135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 12:24:21.922765 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.context [None req-ccd3e33b-afb1-457e-9aa0-739ecb34238b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3542a1b9-19e7-4045-862a-b91b9d20394c(cell1) {{(pid=103136) load_cells /opt/stack/nova/nova/context.py:464}} Jun 30 12:24:21.926835 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG oslo_concurrency.lockutils [None req-ccd3e33b-afb1-457e-9aa0-739ecb34238b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:24:21.928330 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG oslo_concurrency.lockutils [None req-ccd3e33b-afb1-457e-9aa0-739ecb34238b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:24:21.929166 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG oslo_concurrency.lockutils [None req-ccd3e33b-afb1-457e-9aa0-739ecb34238b None None] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:24:21.931157 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG oslo_concurrency.lockutils [None req-ccd3e33b-afb1-457e-9aa0-739ecb34238b None None] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:24:21.933209 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: INFO dbcounter [None req-ccd3e33b-afb1-457e-9aa0-739ecb34238b None None] Registered counter for database nova_cell0 Jun 30 12:24:21.939340 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: INFO dbcounter [None req-ccd3e33b-afb1-457e-9aa0-739ecb34238b None None] Registered counter for database nova_cell1 Jun 30 12:24:21.947440 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG oslo_db.sqlalchemy.engines [None req-ccd3e33b-afb1-457e-9aa0-739ecb34238b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103136) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 12:24:21.949792 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG oslo_db.sqlalchemy.engines [None req-ccd3e33b-afb1-457e-9aa0-739ecb34238b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103136) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 12:24:21.954923 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG dbcounter [-] [103136] Writer thread running {{(pid=103136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 12:24:21.960154 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG dbcounter [-] [103136] Writer thread running {{(pid=103136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 12:24:21.962833 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.context [None req-83d07d05-c8d0-4401-8ddd-cbc12c9fe332 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3542a1b9-19e7-4045-862a-b91b9d20394c(cell1) {{(pid=103135) load_cells /opt/stack/nova/nova/context.py:464}} Jun 30 12:24:21.967002 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG oslo_concurrency.lockutils [None req-83d07d05-c8d0-4401-8ddd-cbc12c9fe332 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:24:21.968574 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG oslo_concurrency.lockutils [None req-83d07d05-c8d0-4401-8ddd-cbc12c9fe332 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:24:21.969500 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG oslo_concurrency.lockutils [None req-83d07d05-c8d0-4401-8ddd-cbc12c9fe332 None None] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:24:21.972068 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG oslo_concurrency.lockutils [None req-83d07d05-c8d0-4401-8ddd-cbc12c9fe332 None None] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:24:21.974128 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: INFO dbcounter [None req-83d07d05-c8d0-4401-8ddd-cbc12c9fe332 None None] Registered counter for database nova_cell0 Jun 30 12:24:21.980185 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: INFO dbcounter [None req-83d07d05-c8d0-4401-8ddd-cbc12c9fe332 None None] Registered counter for database nova_cell1 Jun 30 12:24:21.988000 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG oslo_db.sqlalchemy.engines [None req-83d07d05-c8d0-4401-8ddd-cbc12c9fe332 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103135) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 12:24:21.991581 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG oslo_db.sqlalchemy.engines [None req-83d07d05-c8d0-4401-8ddd-cbc12c9fe332 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103135) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 12:24:21.995059 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG dbcounter [-] [103135] Writer thread running {{(pid=103135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 12:24:22.001454 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG dbcounter [-] [103135] Writer thread running {{(pid=103135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 12:24:22.103639 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: INFO dbcounter [None req-ccd3e33b-afb1-457e-9aa0-739ecb34238b None None] Registered counter for database nova_cell0 Jun 30 12:24:22.113313 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG oslo_db.sqlalchemy.engines [None req-ccd3e33b-afb1-457e-9aa0-739ecb34238b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103136) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 12:24:22.118359 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG dbcounter [-] [103136] Writer thread running {{(pid=103136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 12:24:22.145485 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: INFO dbcounter [None req-83d07d05-c8d0-4401-8ddd-cbc12c9fe332 None None] Registered counter for database nova_cell0 Jun 30 12:24:22.156619 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG oslo_db.sqlalchemy.engines [None req-83d07d05-c8d0-4401-8ddd-cbc12c9fe332 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103135) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 12:24:22.161229 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG dbcounter [-] [103135] Writer thread running {{(pid=103135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 12:24:22.457125 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: WARNING keystonemiddleware.auth_token [None req-ccd3e33b-afb1-457e-9aa0-739ecb34238b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 30 12:24:22.464427 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: WARNING keystonemiddleware.auth_token [None req-ccd3e33b-afb1-457e-9aa0-739ecb34238b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 30 12:24:22.479318 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: WARNING keystonemiddleware.auth_token [None req-83d07d05-c8d0-4401-8ddd-cbc12c9fe332 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 30 12:24:22.486956 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: WARNING keystonemiddleware.auth_token [None req-83d07d05-c8d0-4401-8ddd-cbc12c9fe332 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 30 12:24:22.813011 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: WARNING keystonemiddleware.auth_token [None req-ccd3e33b-afb1-457e-9aa0-739ecb34238b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 30 12:24:22.818896 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: WARNING keystonemiddleware.auth_token [None req-ccd3e33b-afb1-457e-9aa0-739ecb34238b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 30 12:24:22.824240 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55df7e4799c0 pid: 103136 (default app) Jun 30 12:24:22.826380 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi [None req-ccd3e33b-afb1-457e-9aa0-739ecb34238b None None] Calling method '>' {{(pid=103136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:24:22.827578 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: INFO nova.api.openstack.requestlog [None req-ccd3e33b-afb1-457e-9aa0-739ecb34238b None None] 10.222.0.57 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001774 Jun 30 12:24:22.827991 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: [pid: 103136|app: 0|req: 1/1] 10.222.0.57 () {50 vars in 788 bytes} [Thu Jun 30 12:24:22 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:24:22.829816 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: WARNING keystonemiddleware.auth_token [None req-83d07d05-c8d0-4401-8ddd-cbc12c9fe332 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 30 12:24:22.835705 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: WARNING keystonemiddleware.auth_token [None req-83d07d05-c8d0-4401-8ddd-cbc12c9fe332 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 30 12:24:22.841148 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55df7e4799c0 pid: 103135 (default app) Jun 30 12:25:38.272591 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi [None req-ccd3e33b-afb1-457e-9aa0-739ecb34238b None None] Calling method '>' {{(pid=103136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:25:38.273643 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: INFO nova.api.openstack.requestlog [None req-ccd3e33b-afb1-457e-9aa0-739ecb34238b None None] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Jun 30 12:25:38.274233 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: [pid: 103136|app: 0|req: 2/2] 10.222.0.57 () {54 vars in 930 bytes} [Thu Jun 30 12:25:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:25:38.286385 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG dbcounter [-] [103135] Writing DB stats nova_api:SELECT=3 {{(pid=103135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:25:38.287530 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG dbcounter [-] [103135] Writing DB stats nova_cell0:SELECT=3 {{(pid=103135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:25:38.288358 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG dbcounter [-] [103135] Writing DB stats nova_cell1:SELECT=3 {{(pid=103135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:25:38.289320 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG dbcounter [-] [103135] Writing DB stats nova_cell0:SELECT=3 {{(pid=103135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:25:38.721082 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi [None req-87d69cec-f44f-4f80-8868-527dc9d4ef48 admin admin] Calling method '>' {{(pid=103135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:25:38.750359 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: INFO nova.api.openstack.requestlog [None req-87d69cec-f44f-4f80-8868-527dc9d4ef48 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.469471 Jun 30 12:25:38.751227 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: [pid: 103135|app: 0|req: 1/3] 10.222.0.57 () {60 vars in 1291 bytes} [Thu Jun 30 12:25:38 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:25:40.818968 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi [None req-ccd3e33b-afb1-457e-9aa0-739ecb34238b None None] Calling method '>' {{(pid=103136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:25:40.819969 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: INFO nova.api.openstack.requestlog [None req-ccd3e33b-afb1-457e-9aa0-739ecb34238b None None] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Jun 30 12:25:40.820326 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: [pid: 103136|app: 0|req: 3/4] 10.222.0.57 () {54 vars in 930 bytes} [Thu Jun 30 12:25:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:25:40.878881 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi [None req-781c9963-b18b-4f7e-9c93-3269c897706c admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "c1", "ram": 256, "swap": 0, "name": "cirros256", "vcpus": 1, "rxtx_factor": 1.0, "disk": 1}} {{(pid=103135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:25:40.897172 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 30 12:25:40.897172 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: warnings.warn(msg) Jun 30 12:25:40.929625 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: INFO nova.api.openstack.requestlog [None req-781c9963-b18b-4f7e-9c93-3269c897706c admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.103034 Jun 30 12:25:40.930174 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: [pid: 103135|app: 0|req: 2/5] 10.222.0.57 () {64 vars in 1282 bytes} [Thu Jun 30 12:25:40 2022] POST /compute/v2.1/flavors => generated 407 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 12:25:40.944832 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG dbcounter [-] [103136] Writing DB stats nova_api:SELECT=3 {{(pid=103136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:25:40.946143 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG dbcounter [-] [103136] Writing DB stats nova_cell0:SELECT=3 {{(pid=103136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:25:40.946856 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG dbcounter [-] [103136] Writing DB stats nova_cell1:SELECT=3 {{(pid=103136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:25:40.947827 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG dbcounter [-] [103136] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:25:41.155710 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi [None req-a0b00cee-499b-4c46-9e8c-52ce4503c891 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:25:41.158187 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 30 12:25:41.158187 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: warnings.warn(msg) Jun 30 12:25:41.218224 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: INFO nova.api.openstack.requestlog [None req-a0b00cee-499b-4c46-9e8c-52ce4503c891 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.279202 Jun 30 12:25:41.219103 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: [pid: 103136|app: 0|req: 4/6] 10.222.0.57 () {64 vars in 1335 bytes} [Thu Jun 30 12:25:40 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:25:43.292564 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi [None req-781c9963-b18b-4f7e-9c93-3269c897706c admin admin] Calling method '>' {{(pid=103135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:25:43.294245 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: INFO nova.api.openstack.requestlog [None req-781c9963-b18b-4f7e-9c93-3269c897706c admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002171 Jun 30 12:25:43.295260 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: [pid: 103135|app: 0|req: 3/7] 10.222.0.57 () {54 vars in 930 bytes} [Thu Jun 30 12:25:43 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:25:43.423752 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi [None req-2ea7bfc0-adb5-4433-9c90-6c5959449ab9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 5, "vcpus": 1, "name": "ds512M", "id": "d1", "ram": 512}} {{(pid=103136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:25:43.442948 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 30 12:25:43.442948 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: warnings.warn(msg) Jun 30 12:25:43.464355 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: INFO nova.api.openstack.requestlog [None req-2ea7bfc0-adb5-4433-9c90-6c5959449ab9 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.162768 Jun 30 12:25:43.464977 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: [pid: 103136|app: 0|req: 5/8] 10.222.0.57 () {64 vars in 1282 bytes} [Thu Jun 30 12:25:43 2022] POST /compute/v2.1/flavors => generated 404 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 30 12:25:43.476875 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi [None req-f6896ecb-678d-48da-9fa2-9e439626fd53 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:25:43.479058 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 30 12:25:43.479058 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: warnings.warn(msg) Jun 30 12:25:43.513545 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: INFO nova.api.openstack.requestlog [None req-f6896ecb-678d-48da-9fa2-9e439626fd53 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040395 Jun 30 12:25:43.514424 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: [pid: 103135|app: 0|req: 4/9] 10.222.0.57 () {64 vars in 1335 bytes} [Thu Jun 30 12:25:43 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 12:25:45.610748 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi [None req-2ea7bfc0-adb5-4433-9c90-6c5959449ab9 admin admin] Calling method '>' {{(pid=103136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:25:45.611994 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: INFO nova.api.openstack.requestlog [None req-2ea7bfc0-adb5-4433-9c90-6c5959449ab9 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001646 Jun 30 12:25:45.612895 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: [pid: 103136|app: 0|req: 6/10] 10.222.0.57 () {54 vars in 930 bytes} [Thu Jun 30 12:25:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:25:45.674476 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi [None req-e2a4c6ac-7acb-4394-a52a-04263d56c7a7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 10, "swap": 0, "vcpus": 1, "id": "d2", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "name": "ds1G"}} {{(pid=103135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:25:45.693277 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: INFO nova.api.openstack.requestlog [None req-e2a4c6ac-7acb-4394-a52a-04263d56c7a7 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.073891 Jun 30 12:25:45.694129 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: [pid: 103135|app: 0|req: 5/11] 10.222.0.57 () {64 vars in 1282 bytes} [Thu Jun 30 12:25:45 2022] POST /compute/v2.1/flavors => generated 404 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 12:25:45.706267 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi [None req-680acaed-3fef-48dd-8589-315029375c24 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:25:45.731180 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: INFO nova.api.openstack.requestlog [None req-680acaed-3fef-48dd-8589-315029375c24 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028846 Jun 30 12:25:45.731731 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: [pid: 103136|app: 0|req: 7/12] 10.222.0.57 () {64 vars in 1335 bytes} [Thu Jun 30 12:25:45 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:25:47.846475 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi [None req-e2a4c6ac-7acb-4394-a52a-04263d56c7a7 admin admin] Calling method '>' {{(pid=103135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:25:47.847482 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: INFO nova.api.openstack.requestlog [None req-e2a4c6ac-7acb-4394-a52a-04263d56c7a7 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Jun 30 12:25:47.847939 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: [pid: 103135|app: 0|req: 6/13] 10.222.0.57 () {54 vars in 930 bytes} [Thu Jun 30 12:25:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:25:47.911224 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi [None req-2845d7f2-af4f-435b-a29e-a190cac28c0e admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "os-flavor-access:is_public": true, "ram": 2048, "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "disk": 10, "name": "ds2G"}} {{(pid=103136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:25:47.932069 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: INFO nova.api.openstack.requestlog [None req-2845d7f2-af4f-435b-a29e-a190cac28c0e admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074707 Jun 30 12:25:47.933614 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: [pid: 103136|app: 0|req: 8/14] 10.222.0.57 () {64 vars in 1282 bytes} [Thu Jun 30 12:25:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 12:25:47.945347 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi [None req-331a9c52-2edd-4fd3-bbf4-adab82cfe246 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:25:47.969214 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: INFO nova.api.openstack.requestlog [None req-331a9c52-2edd-4fd3-bbf4-adab82cfe246 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027648 Jun 30 12:25:47.969797 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: [pid: 103135|app: 0|req: 7/15] 10.222.0.57 () {64 vars in 1335 bytes} [Thu Jun 30 12:25:47 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 12:25:50.037999 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi [None req-2845d7f2-af4f-435b-a29e-a190cac28c0e admin admin] Calling method '>' {{(pid=103136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:25:50.038967 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: INFO nova.api.openstack.requestlog [None req-2845d7f2-af4f-435b-a29e-a190cac28c0e admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 Jun 30 12:25:50.039344 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: [pid: 103136|app: 0|req: 9/16] 10.222.0.57 () {54 vars in 930 bytes} [Thu Jun 30 12:25:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:25:50.098561 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi [None req-9fc166a2-2afa-4e91-9cf9-5c9b76778d09 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "d4", "ram": 4096, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "name": "ds4G", "disk": 20}} {{(pid=103135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:25:50.118140 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: INFO nova.api.openstack.requestlog [None req-9fc166a2-2afa-4e91-9cf9-5c9b76778d09 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.072267 Jun 30 12:25:50.118796 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: [pid: 103135|app: 0|req: 8/17] 10.222.0.57 () {64 vars in 1282 bytes} [Thu Jun 30 12:25:50 2022] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 30 12:25:50.131093 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi [None req-d930a55f-9e97-4501-8004-8245b3362088 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:25:50.155967 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: INFO nova.api.openstack.requestlog [None req-d930a55f-9e97-4501-8004-8245b3362088 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028578 Jun 30 12:25:50.156562 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: [pid: 103136|app: 0|req: 10/18] 10.222.0.57 () {64 vars in 1335 bytes} [Thu Jun 30 12:25:50 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:25:52.236530 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi [None req-9fc166a2-2afa-4e91-9cf9-5c9b76778d09 admin admin] Calling method '>' {{(pid=103135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:25:52.237613 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: INFO nova.api.openstack.requestlog [None req-9fc166a2-2afa-4e91-9cf9-5c9b76778d09 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001523 Jun 30 12:25:52.238208 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: [pid: 103135|app: 0|req: 9/19] 10.222.0.57 () {54 vars in 930 bytes} [Thu Jun 30 12:25:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:25:52.300671 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi [None req-157d3a6d-c2ce-49bc-b0da-0e238a6331d4 admin admin] Calling method '>' {{(pid=103136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:25:52.324901 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: INFO nova.api.openstack.requestlog [None req-157d3a6d-c2ce-49bc-b0da-0e238a6331d4 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.080521 Jun 30 12:25:52.325784 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: [pid: 103136|app: 0|req: 11/20] 10.222.0.57 () {60 vars in 1291 bytes} [Thu Jun 30 12:25:52 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:25:54.439909 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi [None req-9fc166a2-2afa-4e91-9cf9-5c9b76778d09 admin admin] Calling method '>' {{(pid=103135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:25:54.441015 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: INFO nova.api.openstack.requestlog [None req-9fc166a2-2afa-4e91-9cf9-5c9b76778d09 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002522 Jun 30 12:25:54.441775 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: [pid: 103135|app: 0|req: 10/21] 10.222.0.57 () {54 vars in 930 bytes} [Thu Jun 30 12:25:54 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:25:54.508017 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi [None req-93e1b1fb-5116-4031-adaa-a82ad44429be admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 1, "id": "1", "name": "m1.tiny", "ram": 512}} {{(pid=103136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:25:54.528257 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: INFO nova.api.openstack.requestlog [None req-93e1b1fb-5116-4031-adaa-a82ad44429be admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.080449 Jun 30 12:25:54.528908 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: [pid: 103136|app: 0|req: 12/22] 10.222.0.57 () {64 vars in 1282 bytes} [Thu Jun 30 12:25:54 2022] POST /compute/v2.1/flavors => generated 402 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 12:25:54.541019 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi [None req-a9ea515c-472b-43d5-8d55-1e168a93d7fd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:25:54.567663 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: INFO nova.api.openstack.requestlog [None req-a9ea515c-472b-43d5-8d55-1e168a93d7fd admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030483 Jun 30 12:25:54.568240 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: [pid: 103135|app: 0|req: 11/23] 10.222.0.57 () {64 vars in 1332 bytes} [Thu Jun 30 12:25:54 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 12:25:56.827879 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi [None req-93e1b1fb-5116-4031-adaa-a82ad44429be admin admin] Calling method '>' {{(pid=103136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:25:56.829043 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: INFO nova.api.openstack.requestlog [None req-93e1b1fb-5116-4031-adaa-a82ad44429be admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001788 Jun 30 12:25:56.829544 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: [pid: 103136|app: 0|req: 13/24] 10.222.0.57 () {54 vars in 930 bytes} [Thu Jun 30 12:25:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:25:56.903478 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi [None req-0e91f33c-6eee-435d-af8d-5a34afeb55f4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "disk": 20, "os-flavor-access:is_public": true, "vcpus": 1, "name": "m1.small", "rxtx_factor": 1.0, "swap": 0}} {{(pid=103135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:25:56.925889 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: INFO nova.api.openstack.requestlog [None req-0e91f33c-6eee-435d-af8d-5a34afeb55f4 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.089548 Jun 30 12:25:56.926580 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: [pid: 103135|app: 0|req: 12/25] 10.222.0.57 () {64 vars in 1282 bytes} [Thu Jun 30 12:25:56 2022] POST /compute/v2.1/flavors => generated 405 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 12:25:56.941069 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi [None req-4028d6a4-ae14-4123-9437-2a8d8c9e36b1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:25:56.968782 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: INFO nova.api.openstack.requestlog [None req-4028d6a4-ae14-4123-9437-2a8d8c9e36b1 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032059 Jun 30 12:25:56.969499 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: [pid: 103136|app: 0|req: 14/26] 10.222.0.57 () {64 vars in 1332 bytes} [Thu Jun 30 12:25:56 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:25:59.679721 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi [None req-0e91f33c-6eee-435d-af8d-5a34afeb55f4 admin admin] Calling method '>' {{(pid=103135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:25:59.681833 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: INFO nova.api.openstack.requestlog [None req-0e91f33c-6eee-435d-af8d-5a34afeb55f4 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002268 Jun 30 12:25:59.682625 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: [pid: 103135|app: 0|req: 13/27] 10.222.0.57 () {54 vars in 930 bytes} [Thu Jun 30 12:25:59 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:25:59.757578 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi [None req-61dc0f20-3560-4af4-895c-7bddb01bfc81 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "name": "m1.medium", "swap": 0, "disk": 40, "vcpus": 2, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 4096}} {{(pid=103136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:25:59.779474 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: INFO nova.api.openstack.requestlog [None req-61dc0f20-3560-4af4-895c-7bddb01bfc81 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.090343 Jun 30 12:25:59.780051 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: [pid: 103136|app: 0|req: 15/28] 10.222.0.57 () {64 vars in 1282 bytes} [Thu Jun 30 12:25:59 2022] POST /compute/v2.1/flavors => generated 406 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 12:25:59.793128 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi [None req-85a3f501-b2ec-4d62-9e3b-4ceaa1637cfb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:25:59.820241 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: INFO nova.api.openstack.requestlog [None req-85a3f501-b2ec-4d62-9e3b-4ceaa1637cfb admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030954 Jun 30 12:25:59.821103 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: [pid: 103135|app: 0|req: 14/29] 10.222.0.57 () {64 vars in 1332 bytes} [Thu Jun 30 12:25:59 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:26:01.947349 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi [None req-61dc0f20-3560-4af4-895c-7bddb01bfc81 admin admin] Calling method '>' {{(pid=103136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:26:01.948361 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: INFO nova.api.openstack.requestlog [None req-61dc0f20-3560-4af4-895c-7bddb01bfc81 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002009 Jun 30 12:26:01.948979 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: [pid: 103136|app: 0|req: 16/30] 10.222.0.57 () {54 vars in 930 bytes} [Thu Jun 30 12:26:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:26:02.009950 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi [None req-81e35604-b52d-4cdf-b393-b0db4dc3bcb7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 80, "os-flavor-access:is_public": true, "vcpus": 4, "ram": 8192, "rxtx_factor": 1.0}} {{(pid=103135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:26:02.028974 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: INFO nova.api.openstack.requestlog [None req-81e35604-b52d-4cdf-b393-b0db4dc3bcb7 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.074157 Jun 30 12:26:02.029480 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: [pid: 103135|app: 0|req: 15/31] 10.222.0.57 () {64 vars in 1282 bytes} [Thu Jun 30 12:26:01 2022] POST /compute/v2.1/flavors => generated 405 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 12:26:02.041960 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi [None req-a2701f96-0b47-4609-8e00-50dda7c774c7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:26:02.069056 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: INFO nova.api.openstack.requestlog [None req-a2701f96-0b47-4609-8e00-50dda7c774c7 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031179 Jun 30 12:26:02.069653 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: [pid: 103136|app: 0|req: 17/32] 10.222.0.57 () {64 vars in 1332 bytes} [Thu Jun 30 12:26:02 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:26:04.175965 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi [None req-81e35604-b52d-4cdf-b393-b0db4dc3bcb7 admin admin] Calling method '>' {{(pid=103135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:26:04.176477 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: INFO nova.api.openstack.requestlog [None req-81e35604-b52d-4cdf-b393-b0db4dc3bcb7 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.005123 Jun 30 12:26:04.177183 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: [pid: 103135|app: 0|req: 16/33] 10.222.0.57 () {54 vars in 930 bytes} [Thu Jun 30 12:26:04 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:26:04.244886 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi [None req-620556c0-d7f5-479f-8f39-52add43d4150 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "id": "5", "name": "m1.xlarge", "os-flavor-access:is_public": true, "disk": 160, "rxtx_factor": 1.0}} {{(pid=103136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:26:04.263995 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: INFO nova.api.openstack.requestlog [None req-620556c0-d7f5-479f-8f39-52add43d4150 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.080008 Jun 30 12:26:04.264550 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: [pid: 103136|app: 0|req: 18/34] 10.222.0.57 () {64 vars in 1282 bytes} [Thu Jun 30 12:26:04 2022] POST /compute/v2.1/flavors => generated 408 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 30 12:26:04.276595 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi [None req-2e8f8bce-1d35-4956-9068-d4e07289f261 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:26:04.302414 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: INFO nova.api.openstack.requestlog [None req-2e8f8bce-1d35-4956-9068-d4e07289f261 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029524 Jun 30 12:26:04.303022 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: [pid: 103135|app: 0|req: 17/35] 10.222.0.57 () {64 vars in 1332 bytes} [Thu Jun 30 12:26:04 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:26:28.724805 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi [None req-620556c0-d7f5-479f-8f39-52add43d4150 admin admin] Calling method '>' {{(pid=103136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:26:28.725820 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: INFO nova.api.openstack.requestlog [None req-620556c0-d7f5-479f-8f39-52add43d4150 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Jun 30 12:26:28.726217 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: [pid: 103136|app: 0|req: 19/36] 10.222.0.57 () {54 vars in 930 bytes} [Thu Jun 30 12:26:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:26:28.740022 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG dbcounter [-] [103135] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:26:28.798577 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi [None req-1d18cddf-4bdc-4e5e-bd4a-341e369bc959 admin admin] Calling method '>' {{(pid=103135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:26:28.816000 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: INFO nova.api.openstack.requestlog [None req-1d18cddf-4bdc-4e5e-bd4a-341e369bc959 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.083500 Jun 30 12:26:28.816526 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: [pid: 103135|app: 0|req: 18/37] 10.222.0.57 () {60 vars in 1291 bytes} [Thu Jun 30 12:26:28 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:26:29.770625 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi [None req-620556c0-d7f5-479f-8f39-52add43d4150 admin admin] Calling method '>' {{(pid=103136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:26:29.771625 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: INFO nova.api.openstack.requestlog [None req-620556c0-d7f5-479f-8f39-52add43d4150 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Jun 30 12:26:29.772018 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: [pid: 103136|app: 0|req: 20/38] 10.222.0.57 () {56 vars in 1074 bytes} [Thu Jun 30 12:26:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:26:29.978473 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi [None req-faab42c0-0ca1-4281-9787-fc9ba9cc62a2 admin admin] Calling method '>' {{(pid=103135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:26:29.984496 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: INFO nova.api.openstack.wsgi [None req-faab42c0-0ca1-4281-9787-fc9ba9cc62a2 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 30 12:26:29.987808 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi [None req-faab42c0-0ca1-4281-9787-fc9ba9cc62a2 admin admin] Request method failure captured: Jun 30 12:26:29.987808 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 30 12:26:29.987808 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: Accept: application/json Jun 30 12:26:29.987808 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: Accept-Encoding: gzip, deflate Jun 30 12:26:29.987808 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: Connection: keep-alive Jun 30 12:26:29.987808 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: Content-Length: 0 Jun 30 12:26:29.987808 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: Host: 10.222.0.57 Jun 30 12:26:29.987808 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: Openstack-Api-Version: compute 2.90 Jun 30 12:26:29.987808 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: Openstack-System-Scope: None Jun 30 12:26:29.987808 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: User-Agent: python-novaclient Jun 30 12:26:29.987808 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: X-Auth-Token: gAAAAABivZZ1Rkp6K-An0S4mwZ_AYbMQY_7VcPI470wNphnyQXCq9xs2ezFMU19O7zonu-jvYDcsgpA6eT0Y6-PCTvrOMBamKMF6kGJhoTMzzJN2E4UVj6tYkGdNoJfG2gPVe88nfjnAv2Ie_nOlucvJ5FqZkJ8I1C-txCsS_QvqlHauSWbYlEI Jun 30 12:26:29.987808 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: X-Domain-Id: None Jun 30 12:26:29.987808 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: X-Domain-Name: None Jun 30 12:26:29.987808 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: X-Identity-Status: Confirmed Jun 30 12:26:29.987808 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: X-Is-Admin-Project: True Jun 30 12:26:29.987808 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: X-Openstack-Nova-Api-Version: 2.90 Jun 30 12:26:29.987808 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: X-Project-Domain-Id: default Jun 30 12:26:29.987808 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: X-Project-Domain-Name: Default Jun 30 12:26:29.987808 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: X-Project-Id: e7a9e0309e534d4980ce851f75758fe8 Jun 30 12:26:29.987808 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: X-Project-Name: admin Jun 30 12:26:29.987808 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: X-Role: member,admin,reader Jun 30 12:26:29.987808 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: X-Roles: member,admin,reader Jun 30 12:26:29.989411 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/e7a9e0309e534d4980ce851f75758fe8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e7a9e0309e534d4980ce851f75758fe8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_e7a9e0309e534d4980ce851f75758fe8", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e7a9e0309e534d4980ce851f75758fe8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 30 12:26:29.989411 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: X-Tenant: admin Jun 30 12:26:29.989411 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: X-Tenant-Id: e7a9e0309e534d4980ce851f75758fe8 Jun 30 12:26:29.989411 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: X-Tenant-Name: admin Jun 30 12:26:29.989411 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: X-User: admin Jun 30 12:26:29.989411 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: X-User-Domain-Id: default Jun 30 12:26:29.989411 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: X-User-Domain-Name: Default Jun 30 12:26:29.989411 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: X-User-Id: bfba4b29b3e04e04b163f6e8cff16484 Jun 30 12:26:29.989411 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: X-User-Name: admin Jun 30 12:26:29.989411 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: method: > Jun 30 12:26:29.989411 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: exception: Flavor 42 could not be found. Jun 30 12:26:29.989411 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: action_args: {'id': '42'} Jun 30 12:26:29.989411 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: {{(pid=103135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 12:26:29.989411 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:26:29.990310 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 30 12:26:29.990310 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 30 12:26:29.990310 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 30 12:26:29.990310 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 30 12:26:29.990310 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 30 12:26:29.990310 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 30 12:26:29.990310 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 30 12:26:29.990310 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 30 12:26:29.990310 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 30 12:26:29.990310 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 12:26:29.990310 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 30 12:26:29.990310 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 30 12:26:29.990310 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 30 12:26:29.990310 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi Jun 30 12:26:29.990310 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:26:29.990310 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi Jun 30 12:26:29.990310 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:26:29.990310 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:26:29.990310 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:26:29.991521 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 12:26:29.991521 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 12:26:29.991521 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 12:26:29.991521 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 12:26:29.991521 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 30 12:26:29.991521 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 30 12:26:29.991521 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 30 12:26:29.991521 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi Jun 30 12:26:29.991521 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:26:29.991521 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi Jun 30 12:26:29.991521 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:26:29.991521 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:26:29.991521 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:26:29.991521 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 12:26:29.991521 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 12:26:29.991521 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 30 12:26:29.991521 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi Jun 30 12:26:29.991521 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi [None req-faab42c0-0ca1-4281-9787-fc9ba9cc62a2 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 12:26:29.992786 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: INFO nova.api.openstack.requestlog [None req-faab42c0-0ca1-4281-9787-fc9ba9cc62a2 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.069211 Jun 30 12:26:29.992786 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: [pid: 103135|app: 0|req: 19/39] 10.222.0.57 () {60 vars in 1190 bytes} [Thu Jun 30 12:26:29 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 30 12:26:29.999281 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi [None req-664ccd46-be9d-495f-b49d-75459fca4e38 admin admin] Calling method '>' {{(pid=103136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:26:30.002417 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG dbcounter [-] [103136] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:26:30.023021 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: INFO nova.api.openstack.requestlog [None req-664ccd46-be9d-495f-b49d-75459fca4e38 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027268 Jun 30 12:26:30.023583 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: [pid: 103136|app: 0|req: 21/40] 10.222.0.57 () {60 vars in 1210 bytes} [Thu Jun 30 12:26:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 12:26:30.036487 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi [None req-ac40f732-21d5-4788-93e0-133518f94ffb admin admin] Calling method '>' {{(pid=103135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:26:30.060091 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: INFO nova.api.openstack.requestlog [None req-ac40f732-21d5-4788-93e0-133518f94ffb admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.029485 Jun 30 12:26:30.060686 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: [pid: 103135|app: 0|req: 20/41] 10.222.0.57 () {60 vars in 1210 bytes} [Thu Jun 30 12:26:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:26:30.071426 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi [None req-11776ad5-9acd-4f96-a702-99b70d5d8210 admin admin] Calling method '>' {{(pid=103136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:26:30.077828 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: INFO nova.api.openstack.wsgi [None req-11776ad5-9acd-4f96-a702-99b70d5d8210 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 30 12:26:30.081118 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi [None req-11776ad5-9acd-4f96-a702-99b70d5d8210 admin admin] Request method failure captured: Jun 30 12:26:30.081118 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 30 12:26:30.081118 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: Accept: application/json Jun 30 12:26:30.081118 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: Accept-Encoding: gzip, deflate Jun 30 12:26:30.081118 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: Connection: keep-alive Jun 30 12:26:30.081118 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: Content-Length: 0 Jun 30 12:26:30.081118 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: Host: 10.222.0.57 Jun 30 12:26:30.081118 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: Openstack-Api-Version: compute 2.90 Jun 30 12:26:30.081118 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: Openstack-System-Scope: None Jun 30 12:26:30.081118 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: User-Agent: python-novaclient Jun 30 12:26:30.081118 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: X-Auth-Token: gAAAAABivZZ1Rkp6K-An0S4mwZ_AYbMQY_7VcPI470wNphnyQXCq9xs2ezFMU19O7zonu-jvYDcsgpA6eT0Y6-PCTvrOMBamKMF6kGJhoTMzzJN2E4UVj6tYkGdNoJfG2gPVe88nfjnAv2Ie_nOlucvJ5FqZkJ8I1C-txCsS_QvqlHauSWbYlEI Jun 30 12:26:30.081118 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: X-Domain-Id: None Jun 30 12:26:30.081118 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: X-Domain-Name: None Jun 30 12:26:30.081118 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: X-Identity-Status: Confirmed Jun 30 12:26:30.081118 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: X-Is-Admin-Project: True Jun 30 12:26:30.081118 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: X-Openstack-Nova-Api-Version: 2.90 Jun 30 12:26:30.081118 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: X-Project-Domain-Id: default Jun 30 12:26:30.081118 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: X-Project-Domain-Name: Default Jun 30 12:26:30.081118 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: X-Project-Id: e7a9e0309e534d4980ce851f75758fe8 Jun 30 12:26:30.081118 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: X-Project-Name: admin Jun 30 12:26:30.081118 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: X-Role: member,admin,reader Jun 30 12:26:30.081118 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: X-Roles: member,admin,reader Jun 30 12:26:30.082463 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/e7a9e0309e534d4980ce851f75758fe8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e7a9e0309e534d4980ce851f75758fe8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_e7a9e0309e534d4980ce851f75758fe8", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e7a9e0309e534d4980ce851f75758fe8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 30 12:26:30.082463 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: X-Tenant: admin Jun 30 12:26:30.082463 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: X-Tenant-Id: e7a9e0309e534d4980ce851f75758fe8 Jun 30 12:26:30.082463 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: X-Tenant-Name: admin Jun 30 12:26:30.082463 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: X-User: admin Jun 30 12:26:30.082463 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: X-User-Domain-Id: default Jun 30 12:26:30.082463 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: X-User-Domain-Name: Default Jun 30 12:26:30.082463 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: X-User-Id: bfba4b29b3e04e04b163f6e8cff16484 Jun 30 12:26:30.082463 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: X-User-Name: admin Jun 30 12:26:30.082463 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: method: > Jun 30 12:26:30.082463 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: exception: Flavor 42 could not be found. Jun 30 12:26:30.082463 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: action_args: {'id': '42'} Jun 30 12:26:30.082463 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: {{(pid=103136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 12:26:30.082463 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:26:30.083269 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 30 12:26:30.083269 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 30 12:26:30.083269 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 30 12:26:30.083269 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 30 12:26:30.083269 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 30 12:26:30.083269 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 30 12:26:30.083269 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 30 12:26:30.083269 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 30 12:26:30.083269 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 30 12:26:30.083269 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 12:26:30.083269 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 30 12:26:30.083269 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 30 12:26:30.083269 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 30 12:26:30.083269 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi Jun 30 12:26:30.083269 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:26:30.083269 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi Jun 30 12:26:30.083269 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:26:30.083269 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:26:30.083269 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:26:30.084307 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 12:26:30.084307 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 12:26:30.084307 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 12:26:30.084307 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 12:26:30.084307 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 30 12:26:30.084307 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 30 12:26:30.084307 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 30 12:26:30.084307 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi Jun 30 12:26:30.084307 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:26:30.084307 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi Jun 30 12:26:30.084307 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:26:30.084307 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:26:30.084307 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:26:30.084307 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 12:26:30.084307 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 12:26:30.084307 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 30 12:26:30.084307 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi Jun 30 12:26:30.084307 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi [None req-11776ad5-9acd-4f96-a702-99b70d5d8210 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103136) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 12:26:30.085353 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: INFO nova.api.openstack.requestlog [None req-11776ad5-9acd-4f96-a702-99b70d5d8210 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015501 Jun 30 12:26:30.085353 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: [pid: 103136|app: 0|req: 22/42] 10.222.0.57 () {60 vars in 1190 bytes} [Thu Jun 30 12:26:30 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 30 12:26:30.911907 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi [None req-ac40f732-21d5-4788-93e0-133518f94ffb admin admin] Calling method '>' {{(pid=103135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:26:30.912961 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: INFO nova.api.openstack.requestlog [None req-ac40f732-21d5-4788-93e0-133518f94ffb admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Jun 30 12:26:30.913359 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: [pid: 103135|app: 0|req: 21/43] 10.222.0.57 () {56 vars in 1074 bytes} [Thu Jun 30 12:26:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:26:31.114274 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi [None req-5d701704-5359-46cd-8d95-6daf2cf6f679 admin admin] Calling method '>' {{(pid=103136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:26:31.120799 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: INFO nova.api.openstack.wsgi [None req-5d701704-5359-46cd-8d95-6daf2cf6f679 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 30 12:26:31.122326 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi [None req-5d701704-5359-46cd-8d95-6daf2cf6f679 admin admin] Request method failure captured: Jun 30 12:26:31.122326 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 30 12:26:31.122326 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: Accept: application/json Jun 30 12:26:31.122326 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: Accept-Encoding: gzip, deflate Jun 30 12:26:31.122326 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: Connection: keep-alive Jun 30 12:26:31.122326 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: Content-Length: 0 Jun 30 12:26:31.122326 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: Host: 10.222.0.57 Jun 30 12:26:31.122326 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: Openstack-Api-Version: compute 2.90 Jun 30 12:26:31.122326 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: Openstack-System-Scope: None Jun 30 12:26:31.122326 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: User-Agent: python-novaclient Jun 30 12:26:31.122326 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: X-Auth-Token: gAAAAABivZZ2w8KRLnsYaUlbSVJogoLZpx9YGpOccQ9xmcZjEqAj1KvHsKK4oO1XO9Gfocr0GHJ8MQ_EmqDmK5lTVjuiptecPGORfpKVq4hiaSWnlRzM8VrBeOGThTxRzKdnfvPamIpSxx1yRNzs9N7H3T_P5VGc_PDbavLPYvd_WoyzTyCCDT0 Jun 30 12:26:31.122326 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: X-Domain-Id: None Jun 30 12:26:31.122326 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: X-Domain-Name: None Jun 30 12:26:31.122326 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: X-Identity-Status: Confirmed Jun 30 12:26:31.122326 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: X-Is-Admin-Project: True Jun 30 12:26:31.122326 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: X-Openstack-Nova-Api-Version: 2.90 Jun 30 12:26:31.122326 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: X-Project-Domain-Id: default Jun 30 12:26:31.122326 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: X-Project-Domain-Name: Default Jun 30 12:26:31.122326 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: X-Project-Id: e7a9e0309e534d4980ce851f75758fe8 Jun 30 12:26:31.122326 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: X-Project-Name: admin Jun 30 12:26:31.122326 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: X-Role: member,admin,reader Jun 30 12:26:31.122326 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: X-Roles: member,admin,reader Jun 30 12:26:31.123882 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/e7a9e0309e534d4980ce851f75758fe8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e7a9e0309e534d4980ce851f75758fe8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_e7a9e0309e534d4980ce851f75758fe8", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e7a9e0309e534d4980ce851f75758fe8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 30 12:26:31.123882 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: X-Tenant: admin Jun 30 12:26:31.123882 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: X-Tenant-Id: e7a9e0309e534d4980ce851f75758fe8 Jun 30 12:26:31.123882 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: X-Tenant-Name: admin Jun 30 12:26:31.123882 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: X-User: admin Jun 30 12:26:31.123882 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: X-User-Domain-Id: default Jun 30 12:26:31.123882 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: X-User-Domain-Name: Default Jun 30 12:26:31.123882 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: X-User-Id: bfba4b29b3e04e04b163f6e8cff16484 Jun 30 12:26:31.123882 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: X-User-Name: admin Jun 30 12:26:31.123882 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: method: > Jun 30 12:26:31.123882 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: exception: Flavor 84 could not be found. Jun 30 12:26:31.123882 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: action_args: {'id': '84'} Jun 30 12:26:31.123882 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: {{(pid=103136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 12:26:31.123882 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:26:31.124766 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 30 12:26:31.124766 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 30 12:26:31.124766 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 30 12:26:31.124766 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 30 12:26:31.124766 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 30 12:26:31.124766 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 30 12:26:31.124766 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 30 12:26:31.124766 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 30 12:26:31.124766 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 30 12:26:31.124766 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 12:26:31.124766 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 30 12:26:31.124766 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 30 12:26:31.124766 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 30 12:26:31.124766 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi Jun 30 12:26:31.124766 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:26:31.124766 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi Jun 30 12:26:31.124766 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:26:31.124766 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:26:31.124766 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:26:31.126032 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 12:26:31.126032 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 12:26:31.126032 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 12:26:31.126032 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 12:26:31.126032 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 30 12:26:31.126032 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 30 12:26:31.126032 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 30 12:26:31.126032 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi Jun 30 12:26:31.126032 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:26:31.126032 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi Jun 30 12:26:31.126032 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:26:31.126032 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:26:31.126032 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:26:31.126032 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 12:26:31.126032 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 12:26:31.126032 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 30 12:26:31.126032 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi Jun 30 12:26:31.126032 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi [None req-5d701704-5359-46cd-8d95-6daf2cf6f679 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103136) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 12:26:31.127388 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: INFO nova.api.openstack.requestlog [None req-5d701704-5359-46cd-8d95-6daf2cf6f679 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.072109 Jun 30 12:26:31.127388 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: [pid: 103136|app: 0|req: 23/44] 10.222.0.57 () {60 vars in 1190 bytes} [Thu Jun 30 12:26:31 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 30 12:26:31.133575 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi [None req-9aec32de-3812-4ade-8c51-7fe17c21f8d3 admin admin] Calling method '>' {{(pid=103135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:26:31.147797 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: INFO nova.api.openstack.requestlog [None req-9aec32de-3812-4ade-8c51-7fe17c21f8d3 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017915 Jun 30 12:26:31.149982 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: [pid: 103135|app: 0|req: 22/45] 10.222.0.57 () {60 vars in 1210 bytes} [Thu Jun 30 12:26:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:26:31.162396 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi [None req-ae63eddc-d8a0-4119-9ebc-9fb87efe3db4 admin admin] Calling method '>' {{(pid=103136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:26:31.183501 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: INFO nova.api.openstack.requestlog [None req-ae63eddc-d8a0-4119-9ebc-9fb87efe3db4 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026853 Jun 30 12:26:31.184063 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: [pid: 103136|app: 0|req: 24/46] 10.222.0.57 () {60 vars in 1210 bytes} [Thu Jun 30 12:26:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:26:31.193945 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi [None req-2e635374-7176-49bb-93c1-0326f2083b0f admin admin] Calling method '>' {{(pid=103135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:26:31.199731 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: INFO nova.api.openstack.wsgi [None req-2e635374-7176-49bb-93c1-0326f2083b0f admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 30 12:26:31.201265 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi [None req-2e635374-7176-49bb-93c1-0326f2083b0f admin admin] Request method failure captured: Jun 30 12:26:31.201265 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 30 12:26:31.201265 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: Accept: application/json Jun 30 12:26:31.201265 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: Accept-Encoding: gzip, deflate Jun 30 12:26:31.201265 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: Connection: keep-alive Jun 30 12:26:31.201265 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: Content-Length: 0 Jun 30 12:26:31.201265 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: Host: 10.222.0.57 Jun 30 12:26:31.201265 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: Openstack-Api-Version: compute 2.90 Jun 30 12:26:31.201265 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: Openstack-System-Scope: None Jun 30 12:26:31.201265 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: User-Agent: python-novaclient Jun 30 12:26:31.201265 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: X-Auth-Token: gAAAAABivZZ2w8KRLnsYaUlbSVJogoLZpx9YGpOccQ9xmcZjEqAj1KvHsKK4oO1XO9Gfocr0GHJ8MQ_EmqDmK5lTVjuiptecPGORfpKVq4hiaSWnlRzM8VrBeOGThTxRzKdnfvPamIpSxx1yRNzs9N7H3T_P5VGc_PDbavLPYvd_WoyzTyCCDT0 Jun 30 12:26:31.201265 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: X-Domain-Id: None Jun 30 12:26:31.201265 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: X-Domain-Name: None Jun 30 12:26:31.201265 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: X-Identity-Status: Confirmed Jun 30 12:26:31.201265 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: X-Is-Admin-Project: True Jun 30 12:26:31.201265 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: X-Openstack-Nova-Api-Version: 2.90 Jun 30 12:26:31.201265 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: X-Project-Domain-Id: default Jun 30 12:26:31.201265 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: X-Project-Domain-Name: Default Jun 30 12:26:31.201265 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: X-Project-Id: e7a9e0309e534d4980ce851f75758fe8 Jun 30 12:26:31.201265 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: X-Project-Name: admin Jun 30 12:26:31.201265 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: X-Role: member,admin,reader Jun 30 12:26:31.201265 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: X-Roles: member,admin,reader Jun 30 12:26:31.202571 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/e7a9e0309e534d4980ce851f75758fe8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e7a9e0309e534d4980ce851f75758fe8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_e7a9e0309e534d4980ce851f75758fe8", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e7a9e0309e534d4980ce851f75758fe8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 30 12:26:31.202571 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: X-Tenant: admin Jun 30 12:26:31.202571 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: X-Tenant-Id: e7a9e0309e534d4980ce851f75758fe8 Jun 30 12:26:31.202571 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: X-Tenant-Name: admin Jun 30 12:26:31.202571 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: X-User: admin Jun 30 12:26:31.202571 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: X-User-Domain-Id: default Jun 30 12:26:31.202571 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: X-User-Domain-Name: Default Jun 30 12:26:31.202571 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: X-User-Id: bfba4b29b3e04e04b163f6e8cff16484 Jun 30 12:26:31.202571 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: X-User-Name: admin Jun 30 12:26:31.202571 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: method: > Jun 30 12:26:31.202571 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: exception: Flavor 84 could not be found. Jun 30 12:26:31.202571 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: action_args: {'id': '84'} Jun 30 12:26:31.202571 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: {{(pid=103135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 12:26:31.202571 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:26:31.203389 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 30 12:26:31.203389 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 30 12:26:31.203389 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 30 12:26:31.203389 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 30 12:26:31.203389 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 30 12:26:31.203389 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 30 12:26:31.203389 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 30 12:26:31.203389 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 30 12:26:31.203389 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 30 12:26:31.203389 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 12:26:31.203389 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 30 12:26:31.203389 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 30 12:26:31.203389 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 30 12:26:31.203389 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi Jun 30 12:26:31.203389 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:26:31.203389 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi Jun 30 12:26:31.203389 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:26:31.203389 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:26:31.203389 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:26:31.204767 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 12:26:31.204767 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 12:26:31.204767 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 12:26:31.204767 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 12:26:31.204767 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 30 12:26:31.204767 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 30 12:26:31.204767 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 30 12:26:31.204767 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi Jun 30 12:26:31.204767 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:26:31.204767 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi Jun 30 12:26:31.204767 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:26:31.204767 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:26:31.204767 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:26:31.204767 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 12:26:31.204767 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 12:26:31.204767 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 30 12:26:31.204767 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi Jun 30 12:26:31.204767 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi [None req-2e635374-7176-49bb-93c1-0326f2083b0f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 12:26:31.206058 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: INFO nova.api.openstack.requestlog [None req-2e635374-7176-49bb-93c1-0326f2083b0f admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012314 Jun 30 12:26:31.206058 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: [pid: 103135|app: 0|req: 23/47] 10.222.0.57 () {60 vars in 1190 bytes} [Thu Jun 30 12:26:31 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 30 12:26:32.084862 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi [None req-ae63eddc-d8a0-4119-9ebc-9fb87efe3db4 admin admin] Calling method '>' {{(pid=103136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:26:32.086380 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: INFO nova.api.openstack.requestlog [None req-ae63eddc-d8a0-4119-9ebc-9fb87efe3db4 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002309 Jun 30 12:26:32.086965 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: [pid: 103136|app: 0|req: 25/48] 10.222.0.57 () {56 vars in 1074 bytes} [Thu Jun 30 12:26:32 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:26:32.323036 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi [None req-bb4b2e19-a98e-45ee-b1eb-37d892759861 admin admin] Calling method '>' {{(pid=103135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:26:32.330559 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: INFO nova.api.openstack.wsgi [None req-bb4b2e19-a98e-45ee-b1eb-37d892759861 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 30 12:26:32.332056 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi [None req-bb4b2e19-a98e-45ee-b1eb-37d892759861 admin admin] Request method failure captured: Jun 30 12:26:32.332056 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 30 12:26:32.332056 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: Accept: application/json Jun 30 12:26:32.332056 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: Accept-Encoding: gzip, deflate Jun 30 12:26:32.332056 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: Connection: keep-alive Jun 30 12:26:32.332056 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: Content-Length: 0 Jun 30 12:26:32.332056 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: Host: 10.222.0.57 Jun 30 12:26:32.332056 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: Openstack-Api-Version: compute 2.90 Jun 30 12:26:32.332056 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: Openstack-System-Scope: None Jun 30 12:26:32.332056 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: User-Agent: python-novaclient Jun 30 12:26:32.332056 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: X-Auth-Token: gAAAAABivZZ4dNY_WG5i1GEZKcZPdvpPzBmXKmL2vf1yyxcDJmbDfIUGgQz0dsLpGkieK1Tlw7_cTI39ONqdkkzYmEI8eASRngtdK2hELFXWWK5nTjKYgiZcGkxu_Vn3w8_u8aFkP9buQAC7d6KscWjBINHHMzyx2CVRADbv99kKpBg5jE8vwp8 Jun 30 12:26:32.332056 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: X-Domain-Id: None Jun 30 12:26:32.332056 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: X-Domain-Name: None Jun 30 12:26:32.332056 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: X-Identity-Status: Confirmed Jun 30 12:26:32.332056 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: X-Is-Admin-Project: True Jun 30 12:26:32.332056 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: X-Openstack-Nova-Api-Version: 2.90 Jun 30 12:26:32.332056 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: X-Project-Domain-Id: default Jun 30 12:26:32.332056 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: X-Project-Domain-Name: Default Jun 30 12:26:32.332056 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: X-Project-Id: e7a9e0309e534d4980ce851f75758fe8 Jun 30 12:26:32.332056 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: X-Project-Name: admin Jun 30 12:26:32.332056 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: X-Role: member,admin,reader Jun 30 12:26:32.332056 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: X-Roles: member,admin,reader Jun 30 12:26:32.333412 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/e7a9e0309e534d4980ce851f75758fe8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e7a9e0309e534d4980ce851f75758fe8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_e7a9e0309e534d4980ce851f75758fe8", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e7a9e0309e534d4980ce851f75758fe8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 30 12:26:32.333412 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: X-Tenant: admin Jun 30 12:26:32.333412 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: X-Tenant-Id: e7a9e0309e534d4980ce851f75758fe8 Jun 30 12:26:32.333412 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: X-Tenant-Name: admin Jun 30 12:26:32.333412 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: X-User: admin Jun 30 12:26:32.333412 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: X-User-Domain-Id: default Jun 30 12:26:32.333412 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: X-User-Domain-Name: Default Jun 30 12:26:32.333412 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: X-User-Id: bfba4b29b3e04e04b163f6e8cff16484 Jun 30 12:26:32.333412 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: X-User-Name: admin Jun 30 12:26:32.333412 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: method: > Jun 30 12:26:32.333412 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: exception: Flavor 451 could not be found. Jun 30 12:26:32.333412 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: action_args: {'id': '451'} Jun 30 12:26:32.333412 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: {{(pid=103135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 12:26:32.333412 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:26:32.334191 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 30 12:26:32.334191 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 30 12:26:32.334191 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 30 12:26:32.334191 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 30 12:26:32.334191 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 30 12:26:32.334191 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 30 12:26:32.334191 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 30 12:26:32.334191 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 30 12:26:32.334191 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 30 12:26:32.334191 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 12:26:32.334191 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 30 12:26:32.334191 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 30 12:26:32.334191 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 30 12:26:32.334191 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi Jun 30 12:26:32.334191 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:26:32.334191 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi Jun 30 12:26:32.334191 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:26:32.334191 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:26:32.334191 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:26:32.335211 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 12:26:32.335211 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 12:26:32.335211 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 12:26:32.335211 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 12:26:32.335211 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 30 12:26:32.335211 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 30 12:26:32.335211 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 30 12:26:32.335211 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi Jun 30 12:26:32.335211 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:26:32.335211 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi Jun 30 12:26:32.335211 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:26:32.335211 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:26:32.335211 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:26:32.335211 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 12:26:32.335211 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 12:26:32.335211 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 30 12:26:32.335211 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi Jun 30 12:26:32.335211 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi [None req-bb4b2e19-a98e-45ee-b1eb-37d892759861 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 12:26:32.336416 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: INFO nova.api.openstack.requestlog [None req-bb4b2e19-a98e-45ee-b1eb-37d892759861 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.078202 Jun 30 12:26:32.336416 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: [pid: 103135|app: 0|req: 24/49] 10.222.0.57 () {60 vars in 1193 bytes} [Thu Jun 30 12:26:32 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 30 12:26:32.343536 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi [None req-4dd1004b-2bd8-458b-ba50-3d90a7b02124 admin admin] Calling method '>' {{(pid=103136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:26:32.357620 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: INFO nova.api.openstack.requestlog [None req-4dd1004b-2bd8-458b-ba50-3d90a7b02124 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017732 Jun 30 12:26:32.358182 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: [pid: 103136|app: 0|req: 26/50] 10.222.0.57 () {60 vars in 1210 bytes} [Thu Jun 30 12:26:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:26:32.367888 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi [None req-4ef9731b-7478-48a7-a57f-bb29b7928d34 admin admin] Calling method '>' {{(pid=103135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:26:32.382054 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: INFO nova.api.openstack.requestlog [None req-4ef9731b-7478-48a7-a57f-bb29b7928d34 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017643 Jun 30 12:26:32.382536 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: [pid: 103135|app: 0|req: 25/51] 10.222.0.57 () {60 vars in 1210 bytes} [Thu Jun 30 12:26:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:26:32.392411 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi [None req-f383a01a-835e-4d0f-8ade-403a1e28347f admin admin] Calling method '>' {{(pid=103136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:26:32.398025 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: INFO nova.api.openstack.wsgi [None req-f383a01a-835e-4d0f-8ade-403a1e28347f admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 30 12:26:32.399525 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi [None req-f383a01a-835e-4d0f-8ade-403a1e28347f admin admin] Request method failure captured: Jun 30 12:26:32.399525 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 30 12:26:32.399525 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: Accept: application/json Jun 30 12:26:32.399525 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: Accept-Encoding: gzip, deflate Jun 30 12:26:32.399525 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: Connection: keep-alive Jun 30 12:26:32.399525 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: Content-Length: 0 Jun 30 12:26:32.399525 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: Host: 10.222.0.57 Jun 30 12:26:32.399525 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: Openstack-Api-Version: compute 2.90 Jun 30 12:26:32.399525 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: Openstack-System-Scope: None Jun 30 12:26:32.399525 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: User-Agent: python-novaclient Jun 30 12:26:32.399525 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: X-Auth-Token: gAAAAABivZZ4dNY_WG5i1GEZKcZPdvpPzBmXKmL2vf1yyxcDJmbDfIUGgQz0dsLpGkieK1Tlw7_cTI39ONqdkkzYmEI8eASRngtdK2hELFXWWK5nTjKYgiZcGkxu_Vn3w8_u8aFkP9buQAC7d6KscWjBINHHMzyx2CVRADbv99kKpBg5jE8vwp8 Jun 30 12:26:32.399525 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: X-Domain-Id: None Jun 30 12:26:32.399525 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: X-Domain-Name: None Jun 30 12:26:32.399525 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: X-Identity-Status: Confirmed Jun 30 12:26:32.399525 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: X-Is-Admin-Project: True Jun 30 12:26:32.399525 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: X-Openstack-Nova-Api-Version: 2.90 Jun 30 12:26:32.399525 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: X-Project-Domain-Id: default Jun 30 12:26:32.399525 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: X-Project-Domain-Name: Default Jun 30 12:26:32.399525 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: X-Project-Id: e7a9e0309e534d4980ce851f75758fe8 Jun 30 12:26:32.399525 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: X-Project-Name: admin Jun 30 12:26:32.399525 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: X-Role: member,admin,reader Jun 30 12:26:32.399525 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: X-Roles: member,admin,reader Jun 30 12:26:32.401540 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/e7a9e0309e534d4980ce851f75758fe8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e7a9e0309e534d4980ce851f75758fe8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_e7a9e0309e534d4980ce851f75758fe8", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e7a9e0309e534d4980ce851f75758fe8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 30 12:26:32.401540 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: X-Tenant: admin Jun 30 12:26:32.401540 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: X-Tenant-Id: e7a9e0309e534d4980ce851f75758fe8 Jun 30 12:26:32.401540 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: X-Tenant-Name: admin Jun 30 12:26:32.401540 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: X-User: admin Jun 30 12:26:32.401540 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: X-User-Domain-Id: default Jun 30 12:26:32.401540 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: X-User-Domain-Name: Default Jun 30 12:26:32.401540 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: X-User-Id: bfba4b29b3e04e04b163f6e8cff16484 Jun 30 12:26:32.401540 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: X-User-Name: admin Jun 30 12:26:32.401540 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: method: > Jun 30 12:26:32.401540 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: exception: Flavor 451 could not be found. Jun 30 12:26:32.401540 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: action_args: {'id': '451'} Jun 30 12:26:32.401540 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: {{(pid=103136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 12:26:32.401540 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:26:32.402310 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 30 12:26:32.402310 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 30 12:26:32.402310 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 30 12:26:32.402310 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 30 12:26:32.402310 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 30 12:26:32.402310 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 30 12:26:32.402310 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 30 12:26:32.402310 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 30 12:26:32.402310 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 30 12:26:32.402310 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 12:26:32.402310 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 30 12:26:32.402310 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 30 12:26:32.402310 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 30 12:26:32.402310 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi Jun 30 12:26:32.402310 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:26:32.402310 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi Jun 30 12:26:32.402310 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:26:32.402310 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:26:32.402310 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:26:32.403378 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 12:26:32.403378 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 12:26:32.403378 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 12:26:32.403378 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 12:26:32.403378 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 30 12:26:32.403378 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 30 12:26:32.403378 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 30 12:26:32.403378 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi Jun 30 12:26:32.403378 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:26:32.403378 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi Jun 30 12:26:32.403378 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:26:32.403378 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:26:32.403378 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:26:32.403378 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 12:26:32.403378 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 12:26:32.403378 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 30 12:26:32.403378 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: ERROR nova.api.openstack.wsgi Jun 30 12:26:32.403378 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi [None req-f383a01a-835e-4d0f-8ade-403a1e28347f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103136) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 12:26:32.404353 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: INFO nova.api.openstack.requestlog [None req-f383a01a-835e-4d0f-8ade-403a1e28347f admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012326 Jun 30 12:26:32.404353 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: [pid: 103136|app: 0|req: 27/52] 10.222.0.57 () {60 vars in 1193 bytes} [Thu Jun 30 12:26:32 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 30 12:26:33.232905 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi [None req-4ef9731b-7478-48a7-a57f-bb29b7928d34 admin admin] Calling method '>' {{(pid=103135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:26:33.233923 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: INFO nova.api.openstack.requestlog [None req-4ef9731b-7478-48a7-a57f-bb29b7928d34 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Jun 30 12:26:33.234313 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: [pid: 103135|app: 0|req: 26/53] 10.222.0.57 () {56 vars in 1074 bytes} [Thu Jun 30 12:26:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:26:33.425886 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi [None req-15608fe9-1a3d-4fd9-bf9b-386f1cbee7ca admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:26:33.447141 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: INFO nova.api.openstack.requestlog [None req-15608fe9-1a3d-4fd9-bf9b-386f1cbee7ca admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.075862 Jun 30 12:26:33.447674 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: [pid: 103136|app: 0|req: 28/54] 10.222.0.57 () {64 vars in 1235 bytes} [Thu Jun 30 12:26:33 2022] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 12:26:34.311572 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi [None req-4ef9731b-7478-48a7-a57f-bb29b7928d34 admin admin] Calling method '>' {{(pid=103135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:26:34.312595 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: INFO nova.api.openstack.requestlog [None req-4ef9731b-7478-48a7-a57f-bb29b7928d34 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Jun 30 12:26:34.313027 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: [pid: 103135|app: 0|req: 27/55] 10.222.0.57 () {56 vars in 1074 bytes} [Thu Jun 30 12:26:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:26:34.507632 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi [None req-1c9339f9-440d-4903-988e-a3ba7ad2effd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:26:34.527242 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: INFO nova.api.openstack.requestlog [None req-1c9339f9-440d-4903-988e-a3ba7ad2effd admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.074841 Jun 30 12:26:34.527721 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: [pid: 103136|app: 0|req: 29/56] 10.222.0.57 () {64 vars in 1235 bytes} [Thu Jun 30 12:26:34 2022] POST /compute/v2.1/flavors => generated 405 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 12:26:35.361084 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi [None req-4ef9731b-7478-48a7-a57f-bb29b7928d34 admin admin] Calling method '>' {{(pid=103135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:26:35.362431 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: INFO nova.api.openstack.requestlog [None req-4ef9731b-7478-48a7-a57f-bb29b7928d34 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001995 Jun 30 12:26:35.362950 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: [pid: 103135|app: 0|req: 28/57] 10.222.0.57 () {56 vars in 1074 bytes} [Thu Jun 30 12:26:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:26:35.572529 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi [None req-c9284254-f9b5-4efd-8bb2-692ec7666500 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:26:35.593169 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: INFO nova.api.openstack.requestlog [None req-c9284254-f9b5-4efd-8bb2-692ec7666500 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.085770 Jun 30 12:26:35.593712 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: [pid: 103136|app: 0|req: 30/58] 10.222.0.57 () {64 vars in 1235 bytes} [Thu Jun 30 12:26:35 2022] POST /compute/v2.1/flavors => generated 407 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 12:26:36.425449 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi [None req-4ef9731b-7478-48a7-a57f-bb29b7928d34 admin admin] Calling method '>' {{(pid=103135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:26:36.426482 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: INFO nova.api.openstack.requestlog [None req-4ef9731b-7478-48a7-a57f-bb29b7928d34 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Jun 30 12:26:36.426862 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: [pid: 103135|app: 0|req: 29/59] 10.222.0.57 () {56 vars in 1074 bytes} [Thu Jun 30 12:26:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:26:36.628254 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi [None req-d203b8f7-0acc-40ad-a289-7ecf2b8e1f27 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:26:36.647684 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: INFO nova.api.openstack.requestlog [None req-d203b8f7-0acc-40ad-a289-7ecf2b8e1f27 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.080760 Jun 30 12:26:36.648149 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: [pid: 103136|app: 0|req: 31/60] 10.222.0.57 () {64 vars in 1235 bytes} [Thu Jun 30 12:26:36 2022] POST /compute/v2.1/flavors => generated 409 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 12:26:37.468398 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi [None req-4ef9731b-7478-48a7-a57f-bb29b7928d34 admin admin] Calling method '>' {{(pid=103135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:26:37.469485 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: INFO nova.api.openstack.requestlog [None req-4ef9731b-7478-48a7-a57f-bb29b7928d34 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Jun 30 12:26:37.469866 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: [pid: 103135|app: 0|req: 30/61] 10.222.0.57 () {56 vars in 1074 bytes} [Thu Jun 30 12:26:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:26:37.673167 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi [None req-18c32268-c23f-4e80-8f8f-81b51a6e4eec admin admin] Calling method '>' {{(pid=103136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:26:37.700578 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: INFO nova.api.openstack.requestlog [None req-18c32268-c23f-4e80-8f8f-81b51a6e4eec admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.094570 Jun 30 12:26:37.701137 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: [pid: 103136|app: 0|req: 32/62] 10.222.0.57 () {60 vars in 1202 bytes} [Thu Jun 30 12:26:37 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:27:24.948650 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi [None req-4ef9731b-7478-48a7-a57f-bb29b7928d34 admin admin] Calling method '>' {{(pid=103135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:27:24.949419 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: INFO nova.api.openstack.requestlog [None req-4ef9731b-7478-48a7-a57f-bb29b7928d34 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001539 Jun 30 12:27:24.949821 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: [pid: 103135|app: 0|req: 31/63] 10.222.0.57 () {54 vars in 930 bytes} [Thu Jun 30 12:27:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:27:24.963836 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG dbcounter [-] [103136] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:27:25.024917 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi [None req-fa2b06de-ee46-4e33-a24e-3d6f61f2e32e admin admin] Calling method '>' {{(pid=103136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:27:25.044725 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: INFO nova.api.openstack.requestlog [None req-fa2b06de-ee46-4e33-a24e-3d6f61f2e32e admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.088507 Jun 30 12:27:25.045254 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: [pid: 103136|app: 0|req: 33/64] 10.222.0.57 () {60 vars in 1291 bytes} [Thu Jun 30 12:27:24 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:27:25.078830 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi [None req-b728e50a-cafb-451a-818f-4dc89b321427 admin admin] Calling method '>' {{(pid=103135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:27:25.082339 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG dbcounter [-] [103135] Writing DB stats nova_api:SELECT=14 {{(pid=103135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:27:25.087963 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: INFO nova.api.openstack.requestlog [None req-b728e50a-cafb-451a-818f-4dc89b321427 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012907 Jun 30 12:27:25.088499 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: [pid: 103135|app: 0|req: 32/65] 10.222.0.57 () {60 vars in 1282 bytes} [Thu Jun 30 12:27:25 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:27:25.102620 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi [None req-13f2080e-3b74-44f3-83a2-d74755d5df8d admin admin] Calling method '>' {{(pid=103136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:27:25.111443 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: INFO nova.api.openstack.requestlog [None req-13f2080e-3b74-44f3-83a2-d74755d5df8d admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014594 Jun 30 12:27:25.111964 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: [pid: 103136|app: 0|req: 34/66] 10.222.0.57 () {60 vars in 1285 bytes} [Thu Jun 30 12:27:25 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:27:25.124252 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi [None req-f904599d-e0d7-4ed8-9cf9-36ecbe627cb9 admin admin] Calling method '>' {{(pid=103135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:27:25.132366 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: INFO nova.api.openstack.requestlog [None req-f904599d-e0d7-4ed8-9cf9-36ecbe627cb9 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012281 Jun 30 12:27:25.132844 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: [pid: 103135|app: 0|req: 33/67] 10.222.0.57 () {60 vars in 1285 bytes} [Thu Jun 30 12:27:25 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:27:25.144472 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi [None req-25e73829-682c-4052-b42f-c73ae4edea03 admin admin] Calling method '>' {{(pid=103136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:27:25.152550 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: INFO nova.api.openstack.requestlog [None req-25e73829-682c-4052-b42f-c73ae4edea03 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011631 Jun 30 12:27:25.153099 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: [pid: 103136|app: 0|req: 35/68] 10.222.0.57 () {60 vars in 1282 bytes} [Thu Jun 30 12:27:25 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:30:47.440013 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi [None req-f904599d-e0d7-4ed8-9cf9-36ecbe627cb9 admin admin] Calling method '>' {{(pid=103135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:30:47.441048 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: INFO nova.api.openstack.requestlog [None req-f904599d-e0d7-4ed8-9cf9-36ecbe627cb9 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jun 30 12:30:47.441447 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: [pid: 103135|app: 0|req: 34/69] 10.222.0.57 () {56 vars in 1074 bytes} [Thu Jun 30 12:30:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:30:47.583960 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG dbcounter [-] [103136] Writing DB stats nova_api:SELECT=6 {{(pid=103136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:30:47.723343 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi [None req-a92fe894-5a16-471e-ac46-2e620b0cca2b admin admin] Calling method '>' {{(pid=103136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:30:47.724515 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 30 12:30:47.724515 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: warnings.warn(msg) Jun 30 12:30:47.725740 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG oslo_concurrency.lockutils [None req-a92fe894-5a16-471e-ac46-2e620b0cca2b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:30:47.726175 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG oslo_concurrency.lockutils [None req-a92fe894-5a16-471e-ac46-2e620b0cca2b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:30:47.726948 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG oslo_concurrency.lockutils [None req-a92fe894-5a16-471e-ac46-2e620b0cca2b admin admin] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:30:47.727371 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG oslo_concurrency.lockutils [None req-a92fe894-5a16-471e-ac46-2e620b0cca2b admin admin] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:30:47.761845 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: INFO nova.api.openstack.requestlog [None req-a92fe894-5a16-471e-ac46-2e620b0cca2b admin admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.180380 Jun 30 12:30:47.762405 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: [pid: 103136|app: 0|req: 36/70] 10.222.0.57 () {60 vars in 1193 bytes} [Thu Jun 30 12:30:47 2022] GET /compute/v2.1/os-services => generated 791 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 12:30:48.604157 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi [None req-f904599d-e0d7-4ed8-9cf9-36ecbe627cb9 admin admin] Calling method '>' {{(pid=103135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:30:48.605202 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: INFO nova.api.openstack.requestlog [None req-f904599d-e0d7-4ed8-9cf9-36ecbe627cb9 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Jun 30 12:30:48.605592 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: [pid: 103135|app: 0|req: 35/71] 10.222.0.57 () {56 vars in 1074 bytes} [Thu Jun 30 12:30:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:30:48.808149 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi [None req-b377b5bb-9dea-4c77-add6-cef945e8cca1 admin admin] Calling method '>' {{(pid=103136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:30:48.809352 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 30 12:30:48.809352 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: warnings.warn(msg) Jun 30 12:30:48.810545 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG oslo_concurrency.lockutils [None req-b377b5bb-9dea-4c77-add6-cef945e8cca1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:30:48.810959 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG oslo_concurrency.lockutils [None req-b377b5bb-9dea-4c77-add6-cef945e8cca1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:30:48.811727 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG oslo_concurrency.lockutils [None req-b377b5bb-9dea-4c77-add6-cef945e8cca1 admin admin] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:30:48.812181 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG oslo_concurrency.lockutils [None req-b377b5bb-9dea-4c77-add6-cef945e8cca1 admin admin] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:30:48.832033 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: INFO nova.api.openstack.requestlog [None req-b377b5bb-9dea-4c77-add6-cef945e8cca1 admin admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.085062 Jun 30 12:30:48.832577 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: [pid: 103136|app: 0|req: 37/72] 10.222.0.57 () {60 vars in 1193 bytes} [Thu Jun 30 12:30:48 2022] GET /compute/v2.1/os-services => generated 791 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 12:31:00.107135 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi [None req-f904599d-e0d7-4ed8-9cf9-36ecbe627cb9 admin admin] Calling method '>' {{(pid=103135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:31:00.108154 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: INFO nova.api.openstack.requestlog [None req-f904599d-e0d7-4ed8-9cf9-36ecbe627cb9 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Jun 30 12:31:00.108622 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: [pid: 103135|app: 0|req: 36/73] 10.222.0.57 () {56 vars in 1074 bytes} [Thu Jun 30 12:31:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:31:00.255020 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG dbcounter [-] [103136] Writing DB stats nova_cell0:SELECT=4 {{(pid=103136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:31:00.256199 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG dbcounter [-] [103136] Writing DB stats nova_cell1:SELECT=4 {{(pid=103136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:31:00.257280 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG dbcounter [-] [103136] Writing DB stats nova_api:SELECT=8 {{(pid=103136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:31:00.314869 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi [None req-024a9a8b-c61e-47f7-918d-480d101434b0 admin admin] Calling method '>' {{(pid=103136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:31:00.315965 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 30 12:31:00.315965 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: warnings.warn(msg) Jun 30 12:31:00.317169 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG oslo_concurrency.lockutils [None req-024a9a8b-c61e-47f7-918d-480d101434b0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:31:00.317602 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG oslo_concurrency.lockutils [None req-024a9a8b-c61e-47f7-918d-480d101434b0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:31:00.318400 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG oslo_concurrency.lockutils [None req-024a9a8b-c61e-47f7-918d-480d101434b0 admin admin] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:31:00.318821 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG oslo_concurrency.lockutils [None req-024a9a8b-c61e-47f7-918d-480d101434b0 admin admin] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:31:00.344587 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: INFO nova.api.openstack.requestlog [None req-024a9a8b-c61e-47f7-918d-480d101434b0 admin admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.096923 Jun 30 12:31:00.345172 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: [pid: 103136|app: 0|req: 38/74] 10.222.0.57 () {60 vars in 1193 bytes} [Thu Jun 30 12:31:00 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:31:01.181552 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi [None req-f904599d-e0d7-4ed8-9cf9-36ecbe627cb9 admin admin] Calling method '>' {{(pid=103135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:31:01.183191 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: INFO nova.api.openstack.requestlog [None req-f904599d-e0d7-4ed8-9cf9-36ecbe627cb9 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002322 Jun 30 12:31:01.183809 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: [pid: 103135|app: 0|req: 37/75] 10.222.0.57 () {56 vars in 1074 bytes} [Thu Jun 30 12:31:01 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:31:01.380935 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG nova.api.openstack.wsgi [None req-b6880322-29b6-4d5c-8cb9-580ded9e1fdb admin admin] Calling method '>' {{(pid=103136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:31:01.382149 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 30 12:31:01.382149 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: warnings.warn(msg) Jun 30 12:31:01.383415 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG oslo_concurrency.lockutils [None req-b6880322-29b6-4d5c-8cb9-580ded9e1fdb admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:31:01.383795 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG oslo_concurrency.lockutils [None req-b6880322-29b6-4d5c-8cb9-580ded9e1fdb admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:31:01.384570 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG oslo_concurrency.lockutils [None req-b6880322-29b6-4d5c-8cb9-580ded9e1fdb admin admin] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:31:01.385027 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: DEBUG oslo_concurrency.lockutils [None req-b6880322-29b6-4d5c-8cb9-580ded9e1fdb admin admin] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:31:01.406883 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: INFO nova.api.openstack.requestlog [None req-b6880322-29b6-4d5c-8cb9-580ded9e1fdb admin admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.084127 Jun 30 12:31:01.407450 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: [pid: 103136|app: 0|req: 39/76] 10.222.0.57 () {60 vars in 1193 bytes} [Thu Jun 30 12:31:01 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:31:58.880708 dv-cinder-846146-5-iscsi devstack@n-api.service[103134]: Thu Jun 30 12:31:58 2022 - graceful shutdown triggered... Jun 30 12:31:58.880847 dv-cinder-846146-5-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 30 12:31:58.881649 dv-cinder-846146-5-iscsi devstack@n-api.service[103135]: Gracefully killing worker 1 (pid: 103135)... Jun 30 12:31:58.882009 dv-cinder-846146-5-iscsi devstack@n-api.service[103136]: Gracefully killing worker 2 (pid: 103136)... Jun 30 12:31:59.882466 dv-cinder-846146-5-iscsi devstack@n-api.service[103134]: worker 1 buried after 1 seconds Jun 30 12:31:59.882466 dv-cinder-846146-5-iscsi devstack@n-api.service[103134]: worker 2 buried after 1 seconds Jun 30 12:31:59.882466 dv-cinder-846146-5-iscsi devstack@n-api.service[103134]: goodbye to uWSGI. Jun 30 12:31:59.883902 dv-cinder-846146-5-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 30 12:31:59.884483 dv-cinder-846146-5-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 30 12:31:59.887388 dv-cinder-846146-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 30 12:31:59.896613 dv-cinder-846146-5-iscsi devstack@n-api.service[124280]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 30 12:31:59.899193 dv-cinder-846146-5-iscsi devstack@n-api.service[124280]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 30 12:31:59 2022] *** Jun 30 12:31:59.899354 dv-cinder-846146-5-iscsi devstack@n-api.service[124280]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 30 12:31:59.899482 dv-cinder-846146-5-iscsi devstack@n-api.service[124280]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 30 12:31:59.899601 dv-cinder-846146-5-iscsi devstack@n-api.service[124280]: nodename: dv-cinder-846146-5-iscsi Jun 30 12:31:59.899706 dv-cinder-846146-5-iscsi devstack@n-api.service[124280]: machine: x86_64 Jun 30 12:31:59.899820 dv-cinder-846146-5-iscsi devstack@n-api.service[124280]: clock source: unix Jun 30 12:31:59.899931 dv-cinder-846146-5-iscsi devstack@n-api.service[124280]: pcre jit disabled Jun 30 12:31:59.900035 dv-cinder-846146-5-iscsi devstack@n-api.service[124280]: detected number of CPU cores: 4 Jun 30 12:31:59.900140 dv-cinder-846146-5-iscsi devstack@n-api.service[124280]: current working directory: / Jun 30 12:31:59.900244 dv-cinder-846146-5-iscsi devstack@n-api.service[124280]: detected binary path: /usr/bin/uwsgi-core Jun 30 12:31:59.900355 dv-cinder-846146-5-iscsi devstack@n-api.service[124280]: your processes number limit is 47680 Jun 30 12:31:59.900471 dv-cinder-846146-5-iscsi devstack@n-api.service[124280]: your memory page size is 4096 bytes Jun 30 12:31:59.900585 dv-cinder-846146-5-iscsi devstack@n-api.service[124280]: detected max file descriptor number: 2048 Jun 30 12:31:59.900841 dv-cinder-846146-5-iscsi devstack@n-api.service[124280]: lock engine: pthread robust mutexes Jun 30 12:31:59.901114 dv-cinder-846146-5-iscsi devstack@n-api.service[124280]: thunder lock: enabled Jun 30 12:31:59.901416 dv-cinder-846146-5-iscsi devstack@n-api.service[124280]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 30 12:31:59.901635 dv-cinder-846146-5-iscsi devstack@n-api.service[124280]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 30 12:31:59.945138 dv-cinder-846146-5-iscsi devstack@n-api.service[124280]: Python main interpreter initialized at 0x56230dc6c9c0 Jun 30 12:31:59.945393 dv-cinder-846146-5-iscsi devstack@n-api.service[124280]: python threads support enabled Jun 30 12:31:59.945539 dv-cinder-846146-5-iscsi devstack@n-api.service[124280]: your server socket listen backlog is limited to 100 connections Jun 30 12:31:59.945652 dv-cinder-846146-5-iscsi devstack@n-api.service[124280]: your mercy for graceful operations on workers is 90 seconds Jun 30 12:31:59.946080 dv-cinder-846146-5-iscsi devstack@n-api.service[124280]: mapped 403077 bytes (393 KB) for 2 cores Jun 30 12:31:59.946300 dv-cinder-846146-5-iscsi devstack@n-api.service[124280]: *** Operational MODE: preforking *** Jun 30 12:31:59.946714 dv-cinder-846146-5-iscsi devstack@n-api.service[124280]: *** uWSGI is running in multiple interpreter mode *** Jun 30 12:31:59.946829 dv-cinder-846146-5-iscsi devstack@n-api.service[124280]: spawned uWSGI master process (pid: 124280) Jun 30 12:31:59.947121 dv-cinder-846146-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 30 12:31:59.950711 dv-cinder-846146-5-iscsi devstack@n-api.service[124280]: spawned uWSGI worker 1 (pid: 124297, cores: 1) Jun 30 12:31:59.951355 dv-cinder-846146-5-iscsi devstack@n-api.service[124280]: spawned uWSGI worker 2 (pid: 124298, cores: 1) Jun 30 12:31:59.951686 dv-cinder-846146-5-iscsi devstack@n-api.service[124280]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 30 12:32:00.612695 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 30 12:32:00.656353 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 30 12:32:01.781270 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 30 12:32:01.781270 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: from cryptography.utils import int_from_bytes Jun 30 12:32:01.782054 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 30 12:32:01.782054 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: from cryptography.utils import int_from_bytes Jun 30 12:32:01.879701 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 30 12:32:01.879701 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: from cryptography.utils import int_from_bytes Jun 30 12:32:01.880342 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 30 12:32:01.880342 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: from cryptography.utils import int_from_bytes Jun 30 12:32:04.140521 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 30 12:32:04.140521 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 30 12:32:04.145252 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 30 12:32:04.145252 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 30 12:32:04.145252 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 30 12:32:04.145252 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.145252 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.145252 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.145252 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.145252 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.151079 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.151079 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.151079 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.151079 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.151079 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.151079 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.151079 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846146-5-iscsi {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.151079 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.151908 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.151908 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.151908 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.151908 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.151908 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.151908 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.152318 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.152318 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.152318 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.152318 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.152318 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.152318 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.152782 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.152782 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.152782 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.152782 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.152782 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.152782 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846146-5-iscsi {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.152782 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.152782 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.153293 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.153293 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.153428 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.153619 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.154095 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.154635 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.155125 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.155668 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.156188 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.156777 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.157302 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.157861 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.158361 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.158860 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.159464 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.159961 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.160452 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.160933 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.161435 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.161943 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.162461 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.162964 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.163400 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.163837 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.164345 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.164883 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.165388 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.165869 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.166348 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.166829 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.167300 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.167792 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.168272 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.168786 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.169306 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.169844 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.170363 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.170851 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.171336 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.171924 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.57 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.172561 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.57 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.173147 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.173681 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.174196 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.174702 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.175212 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.175713 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.176577 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.177111 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.177615 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.178124 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.178647 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.179714 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.180165 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.180684 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.181167 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.181677 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.182182 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.182675 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.183173 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.183661 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.184157 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.184668 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.185258 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.185744 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.186250 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.186740 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.187236 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.187756 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.188270 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.188911 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.189442 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.189924 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.190404 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.190904 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.191401 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.191913 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.192408 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.192958 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.193674 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.194182 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.194668 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.195178 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.195671 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.196162 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.196777 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.197273 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.197779 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.198274 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.198768 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.199254 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.199759 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.200251 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.200789 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.201275 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.201769 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.202250 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.202758 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.203269 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.203904 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.204622 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.205152 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.205647 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.206160 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.206748 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.207264 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.207798 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.208289 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.208868 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.209212 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.209549 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.209870 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.210196 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.210529 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.210847 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.211160 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.211475 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.211795 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.212114 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.212449 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.212806 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.213124 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.213444 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.213758 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.214076 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.214415 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.214740 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.215052 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.215397 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.215747 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.216063 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.216389 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.216759 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.217076 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.217391 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.217701 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.218024 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.218361 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.218664 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.219019 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.219353 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.219665 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.219975 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.220284 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.220593 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.220979 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.221292 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.221618 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.221927 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.222242 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.222551 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.222859 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.223169 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.223474 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.223778 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.224080 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.224388 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.224724 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.225045 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.225373 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.225680 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.226030 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.226322 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.226631 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.226939 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.227249 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.227550 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.227864 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.228174 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.228476 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.228843 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.229155 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.229462 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.229781 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.230084 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.230387 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.230700 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.231009 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.231315 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.231626 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.231929 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.232253 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.232565 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.232901 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.233241 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.233569 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.233871 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.234195 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.234516 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.234865 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.235172 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.235473 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.235869 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.236170 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.236475 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.236826 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.237131 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.237435 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.237741 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.238042 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.238344 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.238663 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.238970 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.239439 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.239740 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.240042 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.240385 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.240721 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.241067 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.241414 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.241731 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.242054 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.242362 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.242697 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.242992 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.243296 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.243607 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.243915 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.244233 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.244544 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.244913 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.245243 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.245550 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.245857 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.246169 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.246647 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.246964 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.247307 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.247644 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.247957 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.248441 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.248607 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.248921 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.249231 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.249544 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.249849 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.250155 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.250581 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.251097 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.251521 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.251828 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.252181 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.252458 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.252841 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.253111 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.253423 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.253752 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.254083 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.254390 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.254698 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.255016 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.255325 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.255646 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.255973 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.256233 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.256533 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.256736 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 30 12:32:04.257233 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.257393 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 30 12:32:04.257542 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.257542 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.257846 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 30 12:32:04.258017 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.258169 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 30 12:32:04.258340 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.258501 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 30 12:32:04.258645 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.258810 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.259276 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.259445 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.259595 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.259750 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.259889 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.260035 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.260194 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.260353 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.260512 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.260831 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.260987 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.261127 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.261266 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.261404 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.261556 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.261696 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.261842 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.261989 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.264799 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.264983 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.265144 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.265290 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846146-5-iscsi {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.265442 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.265585 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.265754 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.266098 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.266385 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.266552 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.266701 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.266851 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.266999 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.267155 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.267315 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.267464 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.267611 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.267765 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.267910 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.267910 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.268196 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.268365 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.268514 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.268680 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.268846 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.269024 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.269603 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.269753 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.269903 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.270051 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.270211 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.270363 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.270519 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.270667 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.270816 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.270967 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.271125 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.271273 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.271426 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.271565 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.271704 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.271856 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.272007 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846146-5-iscsi {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.272155 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.272311 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.272460 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.272615 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.272823 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.272972 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.273121 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.273121 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.273408 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.273557 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.273706 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.273852 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.273992 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.273992 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.274280 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.274430 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.274578 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.274830 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.275071 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.275227 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.275385 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.275554 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.275702 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.275843 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.275990 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.276249 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.276486 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.276732 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.276880 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.277027 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.277168 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.277308 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.277472 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.277623 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.277781 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.277931 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.278085 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.278234 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.278376 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.278521 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.278668 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.278823 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.278969 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.279117 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.279257 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.279757 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.279915 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.280082 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.280228 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.280377 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.280377 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.280708 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.280865 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.281115 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.281115 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.281399 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.281574 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.281735 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.281890 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.282031 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.282177 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.282318 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.282466 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.282620 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.282769 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.282917 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.283062 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.283201 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.283339 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.283500 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.283649 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.283788 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.283934 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.284073 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.284211 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.284360 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.284505 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.284674 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.284839 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.285076 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.285315 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.285471 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.285631 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.285772 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.57 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.285930 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.286161 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.57 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.286406 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.286563 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.286732 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.286949 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.287094 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.287233 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.287372 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.287533 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.287680 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.287836 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.287984 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.288131 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.288279 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.288430 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.288578 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.288742 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.288885 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.289039 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.289195 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.289342 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.289499 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.289982 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.290143 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.290293 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.290398 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.290494 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.290641 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.290750 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.290837 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.290919 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.291016 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.291111 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.291204 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.291296 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.291453 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.291603 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.291751 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.291891 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.292029 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.292168 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.292313 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.292463 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.292610 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.292796 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.292938 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.293077 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.293223 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.293383 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.293523 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.293670 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.293818 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.293973 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.294113 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.294263 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.294411 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.294550 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.294688 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.294826 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.294974 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.294974 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.294974 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.294974 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.294974 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.295856 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.296008 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.296150 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.296289 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.296445 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.296782 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.296949 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.297250 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.297407 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.297556 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.297732 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.297876 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.298023 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.298170 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.298319 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.298475 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.298631 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.298772 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.298911 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.299050 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.299198 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.299339 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.299493 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.299655 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.300141 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.300291 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.300291 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.300578 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.301174 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.301318 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.301470 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.301622 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.301770 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.301920 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.302067 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.302227 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.302367 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.302505 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.302644 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.302792 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.302932 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.303084 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.303227 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.303374 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.303521 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.303670 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.303817 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.303956 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.304106 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.304245 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.304463 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.304613 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.304797 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.304938 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.305084 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.305241 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.305482 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.305715 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.305871 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.306012 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.306151 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.306301 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.306454 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.306603 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.306853 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.307005 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.307163 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.307380 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:32:04.307542 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.307701 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.307850 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.307989 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.308139 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.308295 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.308454 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.308594 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.308760 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.308921 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.309157 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.309309 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.309449 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.309596 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.309745 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.309904 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.310381 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.310543 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.310716 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.310860 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.310998 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.311136 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.311273 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.311273 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.311548 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.311694 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.311834 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.311972 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.312119 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.312270 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.312409 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.312567 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.312820 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.312972 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.313128 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.313397 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.313555 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.313703 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.313842 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.313981 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.314130 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.314286 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.314426 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.314565 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.314724 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.314872 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.315026 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.315174 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.315321 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.315494 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.315728 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.315973 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.316120 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.316275 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.316415 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.316561 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.316746 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.317013 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.317168 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.317316 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.317548 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.317712 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.317854 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.318015 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.318157 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.318304 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.318445 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.318591 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.318731 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.318894 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.319042 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.319182 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.319321 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.319467 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.319617 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.319757 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.319905 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.320073 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.320545 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.320733 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.320890 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.321031 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.321199 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.321340 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.321487 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.321627 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.321789 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.321940 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.322088 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.322234 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.322383 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.322532 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.322672 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.322818 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.322967 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.323120 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.323267 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.323417 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.323565 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.323713 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.323852 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.323991 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.324137 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.324294 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.324435 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.324589 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.324753 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.324922 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.325072 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.325225 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.325381 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.325522 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.325661 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.325891 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.326142 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.326290 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.326443 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.326592 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.326741 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.326882 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.327063 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.327293 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.327446 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.327672 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.327818 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.327958 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.328109 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.328257 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.328541 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.328843 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.328995 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.329136 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.329286 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.329445 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.329594 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.329735 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.329875 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.330064 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.330628 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.330780 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.330930 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.331070 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.331210 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.331359 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.331507 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.331647 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.331802 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.331942 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.332088 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.332238 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.332378 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.332571 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.332748 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.332900 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.333041 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.333195 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.333343 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.333492 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.333651 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.333791 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.333940 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.334087 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.334235 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.334383 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.334523 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.334670 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.334824 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.334966 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.335105 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.335251 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.335399 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.335548 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.335697 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.335845 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.336072 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.336225 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.336373 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.336521 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.336704 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.336931 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.337077 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.337225 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.337465 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.337718 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.337946 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.338092 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.338232 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.338380 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.338522 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.338676 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.338817 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.338956 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.339097 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.339322 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.339488 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.339647 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.339808 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.339950 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.340088 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.340228 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.340758 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.340933 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.341094 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.341237 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.341968 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.342125 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.342268 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.342409 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.342560 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.342710 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.342850 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.342997 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.342997 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.343264 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.343410 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.343565 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.343707 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.343846 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.343846 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.344197 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.344197 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.344528 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.344528 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.344964 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.345116 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.345258 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.345258 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.345606 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.345754 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.345901 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.346067 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.346339 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.346502 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.346656 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.346798 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.346963 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.347218 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.347371 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.347649 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.347799 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.347958 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.348178 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.348341 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.348499 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.348704 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.348866 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.349028 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.349168 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.349307 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.349457 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.349598 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.349745 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.349896 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.350045 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.350185 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.350337 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.350487 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.351022 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.351181 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.351335 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.351477 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.351630 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.351773 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.352528 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.352700 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.352850 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.353006 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.353157 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.353315 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.353457 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.353605 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.353769 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.353925 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.354074 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.354222 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.354385 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.354526 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.354673 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.354673 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.354962 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.355102 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.355241 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.355388 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.355543 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.355704 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.355843 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.355933 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.356067 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.356156 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.356240 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.356240 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.356435 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.356435 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.356606 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.356606 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.357049 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.357160 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.357392 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.357509 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.357641 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.357849 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.357981 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.357981 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.358215 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.358402 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.358523 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.358646 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.358771 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.358913 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.359023 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.359110 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.359194 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.359276 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.359372 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.359517 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.359820 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.359980 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.360105 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.360207 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.360294 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.360377 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.360467 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.360558 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.360659 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.360793 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.361152 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.361259 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.361355 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.361440 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.361523 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.361616 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.361710 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.361795 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.361877 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.361968 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.362066 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.362160 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.362250 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.362334 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.362416 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.362505 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.362609 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.362701 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.362701 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.362854 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.362946 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.363038 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.363038 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.363210 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.363294 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.363377 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.363471 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.363614 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.363741 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.363876 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.364010 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.364143 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.364143 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.364360 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.364447 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.364544 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.364644 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.364744 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.364829 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.364921 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.365059 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.365155 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.365240 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.365330 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.365427 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.365520 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.365606 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.365689 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.365780 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.365874 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.365975 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.366061 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.366143 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.366233 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.366317 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.366401 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.366492 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.366577 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.366659 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.366659 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.366811 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.366922 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.367022 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.367108 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.367198 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.367289 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.367393 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.367393 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.367685 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.367779 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.367885 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.367971 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.368061 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.368154 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.368245 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.368329 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.368578 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.368722 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.368822 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.368919 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.369004 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.369112 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.369215 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.369301 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.369383 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.369545 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.369641 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.369741 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.369741 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.369911 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.369911 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.370069 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.370069 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.370233 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.370233 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.370402 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.370487 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.370568 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.370659 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.370743 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.370839 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.370924 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.371030 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.371319 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.371455 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.371594 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.371737 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.371737 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.371948 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.372032 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.372124 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.372208 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.372291 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.372381 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.372466 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.372568 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.372670 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.372755 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.372839 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.372839 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.372988 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.373085 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.373179 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.373264 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.373347 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.373425 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.373508 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.373600 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.373686 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.373777 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.373861 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.373943 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.374032 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.374124 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.374217 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.374301 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.374383 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.374464 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.374559 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.374651 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.374735 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.374817 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.374900 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.374990 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.375083 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.375167 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.375280 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.375372 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.375463 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.375546 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.375638 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.375723 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.375805 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.375887 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.375968 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.376058 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.376154 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.376246 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.376458 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.376557 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.376792 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.376906 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.377101 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.377201 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.377421 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.377518 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.377728 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.377840 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.378037 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.378133 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.378333 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.378423 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.378645 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.378756 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.378948 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.379046 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.379255 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.379355 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.379557 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.379658 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.379864 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.379961 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.380169 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.380267 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.380474 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.380565 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.380813 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.381045 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.381138 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.381471 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.381577 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.381664 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.381755 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.381995 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.382129 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.382301 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.382424 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.382609 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.382706 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.382909 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.383052 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.383209 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.383312 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.383530 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.384344 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.384344 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.384571 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.384763 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.384879 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.385001 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.385114 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.385114 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.385342 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.385531 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.385643 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.385643 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.385854 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.385854 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.386226 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.386354 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.386471 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.386581 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.386696 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.386811 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.386928 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.387046 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.387164 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.387272 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.387381 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.387487 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.387604 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.387736 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.387932 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.388025 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.388109 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.388286 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.388391 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.388590 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.388706 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.389117 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.389438 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.389749 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.390059 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.390193 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.390477 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.390810 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.391144 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.391689 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.391811 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.391899 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.391985 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.392065 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.392143 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.392352 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.392577 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.392743 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.392913 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.393220 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.393315 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.393411 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.393531 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.393631 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.393838 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.393973 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.394157 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.394289 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.394479 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.394581 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.394791 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.394890 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.395112 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.395205 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.395421 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.395511 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.395752 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.395846 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.396092 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.396183 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.396412 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.396509 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.396758 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.396873 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.397066 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.397202 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.397373 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.397477 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.397675 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.397784 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.397977 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.398074 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.398292 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.398392 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.398585 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.398684 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.398915 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.399007 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.399193 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.399292 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.399503 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.399607 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.399805 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.399902 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.400113 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.400211 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.400402 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.400499 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.400748 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.400845 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.401033 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.401125 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.401341 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.401455 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.401649 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.401750 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.401919 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.402017 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.402217 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.402315 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.402515 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.402605 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.402813 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.402902 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.403121 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.403211 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.403437 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.403543 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.403714 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.403804 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.404016 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.404119 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.404316 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.404414 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.404615 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.404744 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.405000 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.405143 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.405280 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.405388 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.405588 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.405692 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.405897 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.405998 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.406203 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.406302 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.406652 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.406909 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.407011 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.407271 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.407372 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.407589 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.407689 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.407961 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.408066 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.408295 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.408431 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.408611 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.408774 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.408949 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.409048 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.409271 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.409366 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.409592 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.409723 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.409904 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.410140 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.410329 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.410453 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.410647 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.410769 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.410963 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.411098 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.411277 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.411424 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.411586 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.411797 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.412048 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.412145 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.412230 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.412351 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.412515 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.412764 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.412884 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.413009 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.413178 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.413269 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.413489 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.413582 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.413821 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.413921 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.414141 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.414272 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.414466 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.414567 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.414768 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.414885 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.415074 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.415249 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.415385 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.415499 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.415698 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.415918 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.416011 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.416235 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.416327 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.416547 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.416667 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.416905 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.416996 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.417232 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.417352 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.417567 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.417691 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.417877 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.417989 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.418191 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.418298 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.418506 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.418648 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.418831 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.418932 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.419151 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.419241 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.419458 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.419552 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.419697 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 30 12:32:04.419802 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.420066 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.420392 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.420740 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.421057 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.421384 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.421799 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.422202 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.422494 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.422821 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.423150 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.423457 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.423767 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.424182 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.424496 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.424828 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.425159 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.425469 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.426134 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.426450 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.426766 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.427074 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.427398 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.427711 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.428022 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.428350 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.428683 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.429012 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.429339 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.429649 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.429976 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.430290 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.430597 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.430902 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.431208 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.431554 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.431861 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.432225 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.432514 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.432877 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.433193 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.433530 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.433859 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.434179 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.434499 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.434828 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.435136 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.435445 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.435756 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.436062 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.436369 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.436711 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.437024 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.437328 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.437635 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.438107 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.438438 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.438752 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.439077 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.439392 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.439700 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.440009 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.440313 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.440706 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.440994 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.441333 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.441654 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.441982 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.442328 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.442633 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.442951 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.443272 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.443589 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.443912 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.444231 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.444550 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.444896 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.445216 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.445529 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.445847 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.446163 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.446486 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.447052 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.447385 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.447705 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.448019 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.448333 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.448666 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.448985 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.449300 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.449611 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.449924 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.450237 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.450569 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.450894 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.451224 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.451562 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.451879 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.452200 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.452516 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.452930 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.453316 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.453771 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.454085 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.454402 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.454720 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.455037 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.455351 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.455666 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.455980 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.456294 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.456612 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.457043 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.457308 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.457624 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.457953 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.458290 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.458611 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.458926 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.459240 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.459559 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.460331 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.460944 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.460944 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.461088 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.461378 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.461751 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.462050 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.462632 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.462738 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.463000 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.463335 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.463672 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.464267 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.464373 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.465306 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.465306 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.465306 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.465572 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.466090 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.466451 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.467102 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.467102 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.467528 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.467738 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.468053 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.469102 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.469102 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.469102 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.469563 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.469778 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.470116 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.470537 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.470833 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.471097 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.471418 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.471737 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.472064 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.472480 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.472969 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.473100 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.473458 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.473782 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.474103 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.474407 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.474867 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.475075 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.475367 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.475676 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.476426 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.476426 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.476609 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.476917 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.477267 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.477644 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.478000 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.478338 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.478625 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.478947 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.479264 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.479591 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.479908 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.480222 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.480577 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.480924 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.481490 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.481831 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.482157 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.482262 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO dbcounter [None req-f5af979e-c5ad-43bc-b690-86da6f805c0c None None] Registered counter for database nova_api Jun 30 12:32:04.482500 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.482837 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.483152 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.483462 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.483769 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.484099 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.484430 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.484803 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.485120 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.485522 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.485840 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.486156 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.486476 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.486788 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.487102 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.487415 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.487727 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.488042 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.488354 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.488764 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.489206 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.489528 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.489849 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.490170 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.490492 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.490807 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.491122 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.491438 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.491753 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.492075 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.492411 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.492752 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.493067 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.493506 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.493820 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.494143 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.494467 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.494778 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.495106 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.495436 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.495750 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.496074 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.496412 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.496747 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.497096 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.497637 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.497768 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.498053 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.498359 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.498678 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.498980 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.499292 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.499608 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.499919 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.500301 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.500786 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.501100 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.501412 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.501711 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.502020 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.502332 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.502514 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_db.sqlalchemy.engines [None req-f5af979e-c5ad-43bc-b690-86da6f805c0c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124298) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 12:32:04.502624 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.502933 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.503241 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.503540 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.503852 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.504157 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.504474 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.504808 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.505116 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.505422 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.505730 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.506040 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.506388 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.506730 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.507046 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.507375 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.507689 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.508017 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.508330 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.508772 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.509089 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.509180 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG dbcounter [-] [124298] Writer thread running {{(pid=124298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 12:32:04.509414 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.509728 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.510067 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.510381 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.510693 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.511005 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.511318 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.511628 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.511942 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.512273 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.512601 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.512928 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.513257 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.513576 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.513899 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.514217 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.514531 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.514865 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.515178 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.515487 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.515832 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.516330 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.516670 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.517023 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.517406 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.517737 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.518070 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.518386 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.518737 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.519071 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.519426 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.519747 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.520166 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.520504 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.520864 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.521185 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.521494 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:32:04.521794 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 30 12:32:04.566819 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.context [None req-f5af979e-c5ad-43bc-b690-86da6f805c0c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3542a1b9-19e7-4045-862a-b91b9d20394c(cell1) {{(pid=124298) load_cells /opt/stack/nova/nova/context.py:464}} Jun 30 12:32:04.570991 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-f5af979e-c5ad-43bc-b690-86da6f805c0c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:32:04.572602 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-f5af979e-c5ad-43bc-b690-86da6f805c0c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:32:04.573412 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-f5af979e-c5ad-43bc-b690-86da6f805c0c None None] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:32:04.575399 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-f5af979e-c5ad-43bc-b690-86da6f805c0c None None] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:32:04.577430 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO dbcounter [None req-f5af979e-c5ad-43bc-b690-86da6f805c0c None None] Registered counter for database nova_cell0 Jun 30 12:32:04.581750 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO dbcounter [None req-f5af979e-c5ad-43bc-b690-86da6f805c0c None None] Registered counter for database nova_cell1 Jun 30 12:32:04.586087 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO dbcounter [None req-efb18e60-bb39-4183-a1ad-7b844773012d None None] Registered counter for database nova_api Jun 30 12:32:04.589336 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_db.sqlalchemy.engines [None req-f5af979e-c5ad-43bc-b690-86da6f805c0c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124298) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 12:32:04.591592 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_db.sqlalchemy.engines [None req-f5af979e-c5ad-43bc-b690-86da6f805c0c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124298) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 12:32:04.600224 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG dbcounter [-] [124298] Writer thread running {{(pid=124298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 12:32:04.600556 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG dbcounter [-] [124298] Writer thread running {{(pid=124298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 12:32:04.605987 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_db.sqlalchemy.engines [None req-efb18e60-bb39-4183-a1ad-7b844773012d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124297) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 12:32:04.613048 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG dbcounter [-] [124297] Writer thread running {{(pid=124297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 12:32:04.669381 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.context [None req-efb18e60-bb39-4183-a1ad-7b844773012d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3542a1b9-19e7-4045-862a-b91b9d20394c(cell1) {{(pid=124297) load_cells /opt/stack/nova/nova/context.py:464}} Jun 30 12:32:04.673556 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-efb18e60-bb39-4183-a1ad-7b844773012d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:32:04.675185 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-efb18e60-bb39-4183-a1ad-7b844773012d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:32:04.676338 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-efb18e60-bb39-4183-a1ad-7b844773012d None None] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:32:04.678355 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-efb18e60-bb39-4183-a1ad-7b844773012d None None] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:32:04.680365 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO dbcounter [None req-efb18e60-bb39-4183-a1ad-7b844773012d None None] Registered counter for database nova_cell0 Jun 30 12:32:04.684389 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO dbcounter [None req-efb18e60-bb39-4183-a1ad-7b844773012d None None] Registered counter for database nova_cell1 Jun 30 12:32:04.692206 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_db.sqlalchemy.engines [None req-efb18e60-bb39-4183-a1ad-7b844773012d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124297) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 12:32:04.694113 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_db.sqlalchemy.engines [None req-efb18e60-bb39-4183-a1ad-7b844773012d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124297) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 12:32:04.699744 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG dbcounter [-] [124297] Writer thread running {{(pid=124297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 12:32:04.702259 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG dbcounter [-] [124297] Writer thread running {{(pid=124297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 12:32:04.749324 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO dbcounter [None req-f5af979e-c5ad-43bc-b690-86da6f805c0c None None] Registered counter for database nova_cell0 Jun 30 12:32:04.757397 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_db.sqlalchemy.engines [None req-f5af979e-c5ad-43bc-b690-86da6f805c0c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124298) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 12:32:04.763002 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG dbcounter [-] [124298] Writer thread running {{(pid=124298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 12:32:04.848729 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO dbcounter [None req-efb18e60-bb39-4183-a1ad-7b844773012d None None] Registered counter for database nova_cell0 Jun 30 12:32:04.857588 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_db.sqlalchemy.engines [None req-efb18e60-bb39-4183-a1ad-7b844773012d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124297) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 12:32:04.862528 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG dbcounter [-] [124297] Writer thread running {{(pid=124297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 12:32:05.110688 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: WARNING keystonemiddleware.auth_token [None req-f5af979e-c5ad-43bc-b690-86da6f805c0c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 30 12:32:05.117984 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: WARNING keystonemiddleware.auth_token [None req-f5af979e-c5ad-43bc-b690-86da6f805c0c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 30 12:32:05.181436 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: WARNING keystonemiddleware.auth_token [None req-efb18e60-bb39-4183-a1ad-7b844773012d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 30 12:32:05.189352 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: WARNING keystonemiddleware.auth_token [None req-efb18e60-bb39-4183-a1ad-7b844773012d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 30 12:32:05.483954 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: WARNING keystonemiddleware.auth_token [None req-f5af979e-c5ad-43bc-b690-86da6f805c0c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 30 12:32:05.490177 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: WARNING keystonemiddleware.auth_token [None req-f5af979e-c5ad-43bc-b690-86da6f805c0c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 30 12:32:05.495610 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56230dc6c9c0 pid: 124298 (default app) Jun 30 12:32:05.536037 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: WARNING keystonemiddleware.auth_token [None req-efb18e60-bb39-4183-a1ad-7b844773012d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 30 12:32:05.542119 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: WARNING keystonemiddleware.auth_token [None req-efb18e60-bb39-4183-a1ad-7b844773012d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 30 12:32:05.547872 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56230dc6c9c0 pid: 124297 (default app) Jun 30 12:32:47.307912 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG dbcounter [-] [124298] Writing DB stats nova_api:SELECT=3 {{(pid=124298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:32:47.308620 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG dbcounter [-] [124298] Writing DB stats nova_cell0:SELECT=3 {{(pid=124298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:32:47.310489 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG dbcounter [-] [124298] Writing DB stats nova_cell1:SELECT=3 {{(pid=124298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:32:47.311493 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG dbcounter [-] [124298] Writing DB stats nova_cell0:SELECT=3 {{(pid=124298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:32:49.240765 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-03b57a7c-d81f-4443-94fd-554d7a7ae130 tempest-VolumesNegativeTest-1242424507 tempest-VolumesNegativeTest-1242424507-project] Action: 'create', calling method: .version_select at 0x7fd0e11d83a0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1444645614", "metadata": {"Type": "work"}}} {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:32:49.275311 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-03b57a7c-d81f-4443-94fd-554d7a7ae130 tempest-VolumesNegativeTest-1242424507 tempest-VolumesNegativeTest-1242424507-project] Request method failure captured: Jun 30 12:32:49.275311 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 30 12:32:49.275311 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Accept: application/json Jun 30 12:32:49.275311 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Accept-Encoding: identity Jun 30 12:32:49.275311 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Connection: close Jun 30 12:32:49.275311 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Content-Length: 122 Jun 30 12:32:49.275311 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Content-Type: application/json Jun 30 12:32:49.275311 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Host: 10.222.0.57 Jun 30 12:32:49.275311 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Openstack-System-Scope: None Jun 30 12:32:49.275311 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: User-Agent: python-urllib3/1.26.9 Jun 30 12:32:49.275311 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Auth-Token: gAAAAABivZfvKeTp1XWM4JR1UZnVkzJRz090RdiWE-Ms-eqr1E8-T4eLIY0Cn3CsPu8o3IxtKvTROsKpANawNeVgQE6U9hmyZGj8EWVOF_g1q8Nk2OvfPRXaU5KdGnynsxqIOScK4QoZoLrLGbYYe02fyp3vVa-zmijUGDJ1bAIUO52_Lxg2E5Q Jun 30 12:32:49.275311 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Domain-Id: None Jun 30 12:32:49.275311 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Domain-Name: None Jun 30 12:32:49.275311 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Identity-Status: Confirmed Jun 30 12:32:49.275311 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Is-Admin-Project: True Jun 30 12:32:49.275311 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Domain-Id: default Jun 30 12:32:49.275311 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Domain-Name: Default Jun 30 12:32:49.275311 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Id: e39c3bfdb43441b1a6241f5d926b62be Jun 30 12:32:49.275311 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Name: tempest-VolumesNegativeTest-1242424507 Jun 30 12:32:49.275311 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Role: member,reader Jun 30 12:32:49.275311 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Roles: member,reader Jun 30 12:32:49.277084 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/e39c3bfdb43441b1a6241f5d926b62be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e39c3bfdb43441b1a6241f5d926b62be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_e39c3bfdb43441b1a6241f5d926b62be", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e39c3bfdb43441b1a6241f5d926b62be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 30 12:32:49.277084 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant: tempest-VolumesNegativeTest-1242424507 Jun 30 12:32:49.277084 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant-Id: e39c3bfdb43441b1a6241f5d926b62be Jun 30 12:32:49.277084 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant-Name: tempest-VolumesNegativeTest-1242424507 Jun 30 12:32:49.277084 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User: tempest-VolumesNegativeTest-1242424507-project Jun 30 12:32:49.277084 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Domain-Id: default Jun 30 12:32:49.277084 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Domain-Name: Default Jun 30 12:32:49.277084 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Id: 04b8b5e97ba6419c999201b8699d0c47 Jun 30 12:32:49.277084 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Name: tempest-VolumesNegativeTest-1242424507-project Jun 30 12:32:49.277084 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Jun 30 12:32:49.277084 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1444645614", "metadata": {"Type": "work"}}} Jun 30 12:32:49.277084 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: method: Jun 30 12:32:49.277084 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 30 12:32:49.277967 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1444645614', 'metadata': {'Type': 'work'}}}} Jun 30 12:32:49.277967 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 12:32:49.277967 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:32:49.277967 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 30 12:32:49.277967 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 30 12:32:49.277967 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 30 12:32:49.277967 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise error Jun 30 12:32:49.277967 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 30 12:32:49.277967 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:32:49.277967 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 30 12:32:49.277967 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 30 12:32:49.277967 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:32:49.277967 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 30 12:32:49.277967 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi '#$%' Jun 30 12:32:49.277967 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:32:49.277967 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:32:49.277967 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:32:49.277967 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:32:49.277967 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:32:49.277967 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:32:49.277967 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 12:32:49.277967 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 12:32:49.280538 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 30 12:32:49.280538 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 30 12:32:49.280538 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 12:32:49.280538 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 12:32:49.280538 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 30 12:32:49.280538 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 30 12:32:49.280538 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 30 12:32:49.280538 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 30 12:32:49.280538 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 30 12:32:49.280538 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 30 12:32:49.280538 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 30 12:32:49.280538 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:32:49.280538 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:32:49.280538 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:32:49.280538 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:32:49.280538 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:32:49.280538 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:32:49.280538 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 30 12:32:49.280538 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 30 12:32:49.282751 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 30 12:32:49.282751 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:32:49.286015 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-03b57a7c-d81f-4443-94fd-554d7a7ae130 tempest-VolumesNegativeTest-1242424507 tempest-VolumesNegativeTest-1242424507-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 12:32:49.287369 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-03b57a7c-d81f-4443-94fd-554d7a7ae130 tempest-VolumesNegativeTest-1242424507 tempest-VolumesNegativeTest-1242424507-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.994637 Jun 30 12:32:49.288413 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 1/1] 10.222.0.57 () {60 vars in 1155 bytes} [Thu Jun 30 12:32:47 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1998 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 30 12:32:49.302921 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG dbcounter [-] [124297] Writing DB stats nova_api:SELECT=3 {{(pid=124297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:32:49.305328 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG dbcounter [-] [124297] Writing DB stats nova_cell0:SELECT=3 {{(pid=124297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:32:49.307856 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG dbcounter [-] [124297] Writing DB stats nova_cell1:SELECT=3 {{(pid=124297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:32:49.310672 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG dbcounter [-] [124297] Writing DB stats nova_cell0:SELECT=3 {{(pid=124297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:32:49.874642 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-d726cb7e-aa84-4507-b53b-99df32bb9a51 tempest-VolumesNegativeTest-1242424507 tempest-VolumesNegativeTest-1242424507-project] Action: 'create', calling method: .version_select at 0x7fd0e12200d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-937733242", "metadata": {"Type": "work"}}} {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:32:49.890601 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-d726cb7e-aa84-4507-b53b-99df32bb9a51 tempest-VolumesNegativeTest-1242424507 tempest-VolumesNegativeTest-1242424507-project] Request method failure captured: Jun 30 12:32:49.890601 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 30 12:32:49.890601 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Accept: application/json Jun 30 12:32:49.890601 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Accept-Encoding: identity Jun 30 12:32:49.890601 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Connection: close Jun 30 12:32:49.890601 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Content-Length: 119 Jun 30 12:32:49.890601 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Content-Type: application/json Jun 30 12:32:49.890601 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Host: 10.222.0.57 Jun 30 12:32:49.890601 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Openstack-System-Scope: None Jun 30 12:32:49.890601 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: User-Agent: python-urllib3/1.26.9 Jun 30 12:32:49.890601 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Auth-Token: gAAAAABivZfvKeTp1XWM4JR1UZnVkzJRz090RdiWE-Ms-eqr1E8-T4eLIY0Cn3CsPu8o3IxtKvTROsKpANawNeVgQE6U9hmyZGj8EWVOF_g1q8Nk2OvfPRXaU5KdGnynsxqIOScK4QoZoLrLGbYYe02fyp3vVa-zmijUGDJ1bAIUO52_Lxg2E5Q Jun 30 12:32:49.890601 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Domain-Id: None Jun 30 12:32:49.890601 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Domain-Name: None Jun 30 12:32:49.890601 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Identity-Status: Confirmed Jun 30 12:32:49.890601 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Is-Admin-Project: True Jun 30 12:32:49.890601 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Project-Domain-Id: default Jun 30 12:32:49.890601 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Project-Domain-Name: Default Jun 30 12:32:49.890601 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Project-Id: e39c3bfdb43441b1a6241f5d926b62be Jun 30 12:32:49.890601 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Project-Name: tempest-VolumesNegativeTest-1242424507 Jun 30 12:32:49.890601 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Role: member,reader Jun 30 12:32:49.890601 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Roles: member,reader Jun 30 12:32:49.892083 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/e39c3bfdb43441b1a6241f5d926b62be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e39c3bfdb43441b1a6241f5d926b62be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_e39c3bfdb43441b1a6241f5d926b62be", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e39c3bfdb43441b1a6241f5d926b62be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 30 12:32:49.892083 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Tenant: tempest-VolumesNegativeTest-1242424507 Jun 30 12:32:49.892083 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Tenant-Id: e39c3bfdb43441b1a6241f5d926b62be Jun 30 12:32:49.892083 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Tenant-Name: tempest-VolumesNegativeTest-1242424507 Jun 30 12:32:49.892083 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User: tempest-VolumesNegativeTest-1242424507-project Jun 30 12:32:49.892083 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User-Domain-Id: default Jun 30 12:32:49.892083 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User-Domain-Name: Default Jun 30 12:32:49.892083 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User-Id: 04b8b5e97ba6419c999201b8699d0c47 Jun 30 12:32:49.892083 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User-Name: tempest-VolumesNegativeTest-1242424507-project Jun 30 12:32:49.892083 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Jun 30 12:32:49.892083 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-937733242", "metadata": {"Type": "work"}}} Jun 30 12:32:49.892083 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: method: Jun 30 12:32:49.892083 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 30 12:32:49.893105 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-937733242', 'metadata': {'Type': 'work'}}}} Jun 30 12:32:49.893105 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 12:32:49.893105 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:32:49.893105 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 30 12:32:49.893105 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 30 12:32:49.893105 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 30 12:32:49.893105 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi raise error Jun 30 12:32:49.893105 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 30 12:32:49.893105 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:32:49.893105 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 30 12:32:49.893105 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 30 12:32:49.893105 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:32:49.893105 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 30 12:32:49.893105 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi '0' Jun 30 12:32:49.893105 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:32:49.893105 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:32:49.893105 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:32:49.893105 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:32:49.893105 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:32:49.893105 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:32:49.893105 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 12:32:49.893105 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 12:32:49.894387 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 30 12:32:49.894387 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 30 12:32:49.894387 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 12:32:49.894387 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 12:32:49.894387 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 30 12:32:49.894387 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 30 12:32:49.894387 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 30 12:32:49.894387 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 30 12:32:49.894387 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 30 12:32:49.894387 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 30 12:32:49.894387 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 30 12:32:49.894387 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:32:49.894387 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:32:49.894387 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:32:49.894387 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:32:49.894387 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:32:49.894387 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:32:49.894387 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 30 12:32:49.894387 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 30 12:32:49.895468 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 30 12:32:49.895468 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:32:49.898851 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-d726cb7e-aa84-4507-b53b-99df32bb9a51 tempest-VolumesNegativeTest-1242424507 tempest-VolumesNegativeTest-1242424507-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 12:32:49.904019 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-d726cb7e-aa84-4507-b53b-99df32bb9a51 tempest-VolumesNegativeTest-1242424507 tempest-VolumesNegativeTest-1242424507-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.608824 Jun 30 12:32:49.909913 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 1/2] 10.222.0.57 () {60 vars in 1155 bytes} [Thu Jun 30 12:32:49 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 613 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 30 12:32:49.917601 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-02f777ca-7ae8-4fbe-b319-bb94531409d3 tempest-VolumesNegativeTest-1242424507 tempest-VolumesNegativeTest-1242424507-project] Action: 'create', calling method: .version_select at 0x7fd0e116f700>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1798614066", "metadata": {"Type": "work"}}} {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:32:49.922050 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-02f777ca-7ae8-4fbe-b319-bb94531409d3 tempest-VolumesNegativeTest-1242424507 tempest-VolumesNegativeTest-1242424507-project] Request method failure captured: Jun 30 12:32:49.922050 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 30 12:32:49.922050 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Accept: application/json Jun 30 12:32:49.922050 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Accept-Encoding: identity Jun 30 12:32:49.922050 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Connection: close Jun 30 12:32:49.922050 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Content-Length: 119 Jun 30 12:32:49.922050 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Content-Type: application/json Jun 30 12:32:49.922050 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Host: 10.222.0.57 Jun 30 12:32:49.922050 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Openstack-System-Scope: None Jun 30 12:32:49.922050 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: User-Agent: python-urllib3/1.26.9 Jun 30 12:32:49.922050 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Auth-Token: gAAAAABivZfvKeTp1XWM4JR1UZnVkzJRz090RdiWE-Ms-eqr1E8-T4eLIY0Cn3CsPu8o3IxtKvTROsKpANawNeVgQE6U9hmyZGj8EWVOF_g1q8Nk2OvfPRXaU5KdGnynsxqIOScK4QoZoLrLGbYYe02fyp3vVa-zmijUGDJ1bAIUO52_Lxg2E5Q Jun 30 12:32:49.922050 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Domain-Id: None Jun 30 12:32:49.922050 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Domain-Name: None Jun 30 12:32:49.922050 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Identity-Status: Confirmed Jun 30 12:32:49.922050 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Is-Admin-Project: True Jun 30 12:32:49.922050 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Domain-Id: default Jun 30 12:32:49.922050 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Domain-Name: Default Jun 30 12:32:49.922050 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Id: e39c3bfdb43441b1a6241f5d926b62be Jun 30 12:32:49.922050 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Name: tempest-VolumesNegativeTest-1242424507 Jun 30 12:32:49.922050 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Role: member,reader Jun 30 12:32:49.922050 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Roles: member,reader Jun 30 12:32:49.923563 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/e39c3bfdb43441b1a6241f5d926b62be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e39c3bfdb43441b1a6241f5d926b62be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_e39c3bfdb43441b1a6241f5d926b62be", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e39c3bfdb43441b1a6241f5d926b62be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 30 12:32:49.923563 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant: tempest-VolumesNegativeTest-1242424507 Jun 30 12:32:49.923563 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant-Id: e39c3bfdb43441b1a6241f5d926b62be Jun 30 12:32:49.923563 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant-Name: tempest-VolumesNegativeTest-1242424507 Jun 30 12:32:49.923563 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User: tempest-VolumesNegativeTest-1242424507-project Jun 30 12:32:49.923563 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Domain-Id: default Jun 30 12:32:49.923563 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Domain-Name: Default Jun 30 12:32:49.923563 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Id: 04b8b5e97ba6419c999201b8699d0c47 Jun 30 12:32:49.923563 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Name: tempest-VolumesNegativeTest-1242424507-project Jun 30 12:32:49.923563 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Jun 30 12:32:49.923563 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1798614066", "metadata": {"Type": "work"}}} Jun 30 12:32:49.923563 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: method: Jun 30 12:32:49.923563 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 30 12:32:49.924934 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1798614066', 'metadata': {'Type': 'work'}}}} Jun 30 12:32:49.924934 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 12:32:49.924934 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:32:49.924934 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 30 12:32:49.924934 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 30 12:32:49.924934 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 30 12:32:49.924934 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise error Jun 30 12:32:49.924934 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 30 12:32:49.924934 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:32:49.924934 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 30 12:32:49.924934 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 30 12:32:49.924934 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:32:49.924934 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 30 12:32:49.924934 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi '' Jun 30 12:32:49.924934 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:32:49.924934 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:32:49.924934 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:32:49.924934 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:32:49.924934 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:32:49.924934 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:32:49.924934 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 12:32:49.924934 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 12:32:49.926352 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 30 12:32:49.926352 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 30 12:32:49.926352 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 12:32:49.926352 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 12:32:49.926352 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 30 12:32:49.926352 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 30 12:32:49.926352 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 30 12:32:49.926352 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 30 12:32:49.926352 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 30 12:32:49.926352 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 30 12:32:49.926352 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 30 12:32:49.926352 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:32:49.926352 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:32:49.926352 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:32:49.926352 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:32:49.926352 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:32:49.926352 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:32:49.926352 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 30 12:32:49.926352 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 30 12:32:49.928810 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 30 12:32:49.928810 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:32:49.932311 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-02f777ca-7ae8-4fbe-b319-bb94531409d3 tempest-VolumesNegativeTest-1242424507 tempest-VolumesNegativeTest-1242424507-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 12:32:49.934098 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-02f777ca-7ae8-4fbe-b319-bb94531409d3 tempest-VolumesNegativeTest-1242424507 tempest-VolumesNegativeTest-1242424507-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.022516 Jun 30 12:32:49.935021 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 2/3] 10.222.0.57 () {60 vars in 1155 bytes} [Thu Jun 30 12:32:49 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 30 12:32:49.956400 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-e7c3f9ff-10c5-4837-a161-e57c15e8a81f tempest-VolumesNegativeTest-1242424507 tempest-VolumesNegativeTest-1242424507-project] Calling method '.version_select at 0x7fd0e1a095e0>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:32:50.751504 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.wsgi [None req-e7c3f9ff-10c5-4837-a161-e57c15e8a81f tempest-VolumesNegativeTest-1242424507 tempest-VolumesNegativeTest-1242424507-project] HTTP exception thrown: Volume tempest-invalid-1547451077 could not be found. Jun 30 12:32:50.755758 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-e7c3f9ff-10c5-4837-a161-e57c15e8a81f tempest-VolumesNegativeTest-1242424507 tempest-VolumesNegativeTest-1242424507-project] Request method failure captured: Jun 30 12:32:50.755758 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1547451077 HTTP/1.1 Jun 30 12:32:50.755758 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Accept: application/json Jun 30 12:32:50.755758 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Accept-Encoding: identity Jun 30 12:32:50.755758 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Connection: close Jun 30 12:32:50.755758 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Content-Length: 0 Jun 30 12:32:50.755758 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Content-Type: application/json Jun 30 12:32:50.755758 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Host: 10.222.0.57 Jun 30 12:32:50.755758 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Openstack-System-Scope: None Jun 30 12:32:50.755758 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: User-Agent: python-urllib3/1.26.9 Jun 30 12:32:50.755758 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Auth-Token: gAAAAABivZfvKeTp1XWM4JR1UZnVkzJRz090RdiWE-Ms-eqr1E8-T4eLIY0Cn3CsPu8o3IxtKvTROsKpANawNeVgQE6U9hmyZGj8EWVOF_g1q8Nk2OvfPRXaU5KdGnynsxqIOScK4QoZoLrLGbYYe02fyp3vVa-zmijUGDJ1bAIUO52_Lxg2E5Q Jun 30 12:32:50.755758 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Domain-Id: None Jun 30 12:32:50.755758 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Domain-Name: None Jun 30 12:32:50.755758 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Identity-Status: Confirmed Jun 30 12:32:50.755758 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Is-Admin-Project: True Jun 30 12:32:50.755758 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Project-Domain-Id: default Jun 30 12:32:50.755758 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Project-Domain-Name: Default Jun 30 12:32:50.755758 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Project-Id: e39c3bfdb43441b1a6241f5d926b62be Jun 30 12:32:50.755758 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Project-Name: tempest-VolumesNegativeTest-1242424507 Jun 30 12:32:50.755758 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Role: member,reader Jun 30 12:32:50.755758 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Roles: member,reader Jun 30 12:32:50.757079 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/e39c3bfdb43441b1a6241f5d926b62be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e39c3bfdb43441b1a6241f5d926b62be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_e39c3bfdb43441b1a6241f5d926b62be", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e39c3bfdb43441b1a6241f5d926b62be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 30 12:32:50.757079 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Tenant: tempest-VolumesNegativeTest-1242424507 Jun 30 12:32:50.757079 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Tenant-Id: e39c3bfdb43441b1a6241f5d926b62be Jun 30 12:32:50.757079 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Tenant-Name: tempest-VolumesNegativeTest-1242424507 Jun 30 12:32:50.757079 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User: tempest-VolumesNegativeTest-1242424507-project Jun 30 12:32:50.757079 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User-Domain-Id: default Jun 30 12:32:50.757079 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User-Domain-Name: Default Jun 30 12:32:50.757079 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User-Id: 04b8b5e97ba6419c999201b8699d0c47 Jun 30 12:32:50.757079 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User-Name: tempest-VolumesNegativeTest-1242424507-project Jun 30 12:32:50.757079 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: method: Jun 30 12:32:50.757079 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: exception: Volume tempest-invalid-1547451077 could not be found. Jun 30 12:32:50.757079 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: action_args: {'id': 'tempest-invalid-1547451077'} Jun 30 12:32:50.757079 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 12:32:50.757859 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:32:50.757859 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 12:32:50.757859 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 12:32:50.757859 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 30 12:32:50.757859 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 30 12:32:50.757859 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 30 12:32:50.757859 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 30 12:32:50.757859 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 30 12:32:50.757859 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 30 12:32:50.757859 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 30 12:32:50.757859 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 30 12:32:50.757859 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 12:32:50.757859 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 12:32:50.757859 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 12:32:50.757859 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 12:32:50.757859 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1547451077 could not be found. (HTTP 404) (Request-ID: req-fb3f30e6-b3ef-4cc8-8e2a-169ef7324d0d) Jun 30 12:32:50.757859 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:32:50.757859 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:32:50.757859 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:32:50.764305 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:32:50.764305 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 30 12:32:50.764305 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 30 12:32:50.764305 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 30 12:32:50.764305 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 30 12:32:50.764305 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 30 12:32:50.764305 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 30 12:32:50.764305 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 30 12:32:50.764305 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 30 12:32:50.764305 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 12:32:50.764305 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 12:32:50.764305 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 30 12:32:50.764305 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 30 12:32:50.764305 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 30 12:32:50.764305 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 30 12:32:50.764305 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 30 12:32:50.764305 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 30 12:32:50.764305 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 30 12:32:50.764305 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 30 12:32:50.766756 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 12:32:50.766756 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 12:32:50.766756 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 12:32:50.766756 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 12:32:50.766756 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1547451077 could not be found. Jun 30 12:32:50.766756 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:32:50.766756 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:32:50.766756 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:32:50.766756 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:32:50.766756 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:32:50.766756 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:32:50.766756 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 12:32:50.766756 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 12:32:50.766756 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 30 12:32:50.766756 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 30 12:32:50.766756 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 12:32:50.766756 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 12:32:50.766756 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 30 12:32:50.766756 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 12:32:50.766756 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1547451077 could not be found. Jun 30 12:32:50.776083 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:32:50.776083 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:32:50.776083 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:32:50.776083 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:32:50.776083 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:32:50.776083 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:32:50.776083 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 12:32:50.776083 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 12:32:50.776083 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1547451077 could not be found. Jun 30 12:32:50.776083 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:32:50.776083 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-e7c3f9ff-10c5-4837-a161-e57c15e8a81f tempest-VolumesNegativeTest-1242424507 tempest-VolumesNegativeTest-1242424507-project] Returning 404 to user: Volume tempest-invalid-1547451077 could not be found. {{(pid=124297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 12:32:50.776083 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-e7c3f9ff-10c5-4837-a161-e57c15e8a81f tempest-VolumesNegativeTest-1242424507 tempest-VolumesNegativeTest-1242424507-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1547451077" status: 404 len: 99 microversion: 2.1 time: 0.816618 Jun 30 12:32:50.776083 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 2/4] 10.222.0.57 () {58 vars in 1217 bytes} [Thu Jun 30 12:32:49 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1547451077 => generated 99 bytes in 818 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jun 30 12:32:50.786470 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-0bf5f0ad-8b56-4c40-984f-9638e03ec744 tempest-VolumesNegativeTest-1242424507 tempest-VolumesNegativeTest-1242424507-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.008034 Jun 30 12:32:50.786470 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 3/5] 10.222.0.57 () {58 vars in 1139 bytes} [Thu Jun 30 12:32:50 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 15 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 30 12:32:50.787881 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-1157b658-4a5b-4224-955f-cc75f3161ad5 tempest-VolumesNegativeTest-1242424507 tempest-VolumesNegativeTest-1242424507-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004393 Jun 30 12:32:50.788406 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 3/6] 10.222.0.57 () {58 vars in 1136 bytes} [Thu Jun 30 12:32:50 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 30 12:32:50.799542 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-0c9bcc52-df9f-4d22-a178-0d54a26e0838 tempest-VolumesNegativeTest-1242424507 tempest-VolumesNegativeTest-1242424507-project] Calling method '.version_select at 0x7fd0e1297d30>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:32:50.900755 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-96f4f009-f706-4664-a04d-664c5c5f255e tempest-VolumesTestJSON-1749974804 tempest-VolumesTestJSON-1749974804-project] Calling method '.version_select at 0x7fd0e102a1f0>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:32:51.056959 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-96f4f009-f706-4664-a04d-664c5c5f255e tempest-VolumesTestJSON-1749974804 tempest-VolumesTestJSON-1749974804-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/577bbfd0-3015-47a3-94a1-a03c92dd142e" status: 200 len: 351 microversion: 2.1 time: 0.160044 Jun 30 12:32:51.057535 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 4/7] 10.222.0.57 () {58 vars in 1244 bytes} [Thu Jun 30 12:32:50 2022] GET /compute/v2.1/os-volumes/577bbfd0-3015-47a3-94a1-a03c92dd142e => generated 351 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 12:32:51.216382 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.wsgi [None req-0c9bcc52-df9f-4d22-a178-0d54a26e0838 tempest-VolumesNegativeTest-1242424507 tempest-VolumesNegativeTest-1242424507-project] HTTP exception thrown: Volume ba2fddbb-011f-4047-beaf-d279527f4d45 could not be found. Jun 30 12:32:51.221529 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-0c9bcc52-df9f-4d22-a178-0d54a26e0838 tempest-VolumesNegativeTest-1242424507 tempest-VolumesNegativeTest-1242424507-project] Request method failure captured: Jun 30 12:32:51.221529 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: request: DELETE /compute/v2.1/os-volumes/ba2fddbb-011f-4047-beaf-d279527f4d45 HTTP/1.1 Jun 30 12:32:51.221529 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Accept: application/json Jun 30 12:32:51.221529 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Accept-Encoding: identity Jun 30 12:32:51.221529 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Connection: close Jun 30 12:32:51.221529 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Content-Length: 0 Jun 30 12:32:51.221529 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Content-Type: application/json Jun 30 12:32:51.221529 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Host: 10.222.0.57 Jun 30 12:32:51.221529 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Openstack-System-Scope: None Jun 30 12:32:51.221529 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: User-Agent: python-urllib3/1.26.9 Jun 30 12:32:51.221529 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Auth-Token: gAAAAABivZfvKeTp1XWM4JR1UZnVkzJRz090RdiWE-Ms-eqr1E8-T4eLIY0Cn3CsPu8o3IxtKvTROsKpANawNeVgQE6U9hmyZGj8EWVOF_g1q8Nk2OvfPRXaU5KdGnynsxqIOScK4QoZoLrLGbYYe02fyp3vVa-zmijUGDJ1bAIUO52_Lxg2E5Q Jun 30 12:32:51.221529 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Domain-Id: None Jun 30 12:32:51.221529 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Domain-Name: None Jun 30 12:32:51.221529 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Identity-Status: Confirmed Jun 30 12:32:51.221529 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Is-Admin-Project: True Jun 30 12:32:51.221529 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Domain-Id: default Jun 30 12:32:51.221529 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Domain-Name: Default Jun 30 12:32:51.221529 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Id: e39c3bfdb43441b1a6241f5d926b62be Jun 30 12:32:51.221529 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Name: tempest-VolumesNegativeTest-1242424507 Jun 30 12:32:51.221529 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Role: member,reader Jun 30 12:32:51.221529 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Roles: member,reader Jun 30 12:32:51.222818 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/e39c3bfdb43441b1a6241f5d926b62be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e39c3bfdb43441b1a6241f5d926b62be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_e39c3bfdb43441b1a6241f5d926b62be", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e39c3bfdb43441b1a6241f5d926b62be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 30 12:32:51.222818 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant: tempest-VolumesNegativeTest-1242424507 Jun 30 12:32:51.222818 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant-Id: e39c3bfdb43441b1a6241f5d926b62be Jun 30 12:32:51.222818 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant-Name: tempest-VolumesNegativeTest-1242424507 Jun 30 12:32:51.222818 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User: tempest-VolumesNegativeTest-1242424507-project Jun 30 12:32:51.222818 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Domain-Id: default Jun 30 12:32:51.222818 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Domain-Name: Default Jun 30 12:32:51.222818 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Id: 04b8b5e97ba6419c999201b8699d0c47 Jun 30 12:32:51.222818 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Name: tempest-VolumesNegativeTest-1242424507-project Jun 30 12:32:51.222818 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: method: Jun 30 12:32:51.222818 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: exception: Volume ba2fddbb-011f-4047-beaf-d279527f4d45 could not be found. Jun 30 12:32:51.222818 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: action_args: {'id': 'ba2fddbb-011f-4047-beaf-d279527f4d45'} Jun 30 12:32:51.222818 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 12:32:51.223590 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:32:51.223590 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 12:32:51.223590 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 12:32:51.223590 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 30 12:32:51.223590 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 30 12:32:51.223590 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 30 12:32:51.223590 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 30 12:32:51.223590 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 30 12:32:51.223590 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 30 12:32:51.223590 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 30 12:32:51.223590 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 30 12:32:51.223590 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 12:32:51.223590 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 12:32:51.223590 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 12:32:51.223590 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 12:32:51.223590 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ba2fddbb-011f-4047-beaf-d279527f4d45 could not be found. (HTTP 404) (Request-ID: req-94864e9a-b63a-4c19-abf9-01020956dbe7) Jun 30 12:32:51.223590 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:32:51.223590 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:32:51.223590 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:32:51.224686 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:32:51.224686 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 30 12:32:51.224686 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 30 12:32:51.224686 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 30 12:32:51.224686 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 30 12:32:51.224686 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 30 12:32:51.224686 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 30 12:32:51.224686 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 30 12:32:51.224686 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 30 12:32:51.224686 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 12:32:51.224686 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 12:32:51.224686 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 30 12:32:51.224686 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 30 12:32:51.224686 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 30 12:32:51.224686 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 30 12:32:51.224686 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 30 12:32:51.224686 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 30 12:32:51.224686 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 30 12:32:51.224686 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 30 12:32:51.225794 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 12:32:51.225794 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 12:32:51.225794 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 12:32:51.225794 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 12:32:51.225794 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ba2fddbb-011f-4047-beaf-d279527f4d45 could not be found. Jun 30 12:32:51.225794 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:32:51.225794 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:32:51.225794 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:32:51.225794 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:32:51.225794 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:32:51.225794 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:32:51.225794 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 12:32:51.225794 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 12:32:51.225794 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 30 12:32:51.225794 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 30 12:32:51.225794 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 12:32:51.225794 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 12:32:51.225794 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 30 12:32:51.225794 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 12:32:51.226952 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ba2fddbb-011f-4047-beaf-d279527f4d45 could not be found. Jun 30 12:32:51.226952 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:32:51.226952 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:32:51.226952 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:32:51.226952 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:32:51.226952 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:32:51.226952 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:32:51.226952 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 12:32:51.226952 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 12:32:51.226952 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ba2fddbb-011f-4047-beaf-d279527f4d45 could not be found. Jun 30 12:32:51.226952 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:32:51.226952 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-0c9bcc52-df9f-4d22-a178-0d54a26e0838 tempest-VolumesNegativeTest-1242424507 tempest-VolumesNegativeTest-1242424507-project] Returning 404 to user: Volume ba2fddbb-011f-4047-beaf-d279527f4d45 could not be found. {{(pid=124298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 12:32:51.226952 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-0c9bcc52-df9f-4d22-a178-0d54a26e0838 tempest-VolumesNegativeTest-1242424507 tempest-VolumesNegativeTest-1242424507-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/ba2fddbb-011f-4047-beaf-d279527f4d45" status: 404 len: 109 microversion: 2.1 time: 0.428872 Jun 30 12:32:51.226952 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 4/8] 10.222.0.57 () {58 vars in 1247 bytes} [Thu Jun 30 12:32:50 2022] DELETE /compute/v2.1/os-volumes/ba2fddbb-011f-4047-beaf-d279527f4d45 => generated 109 bytes in 430 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 12:32:51.233264 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-c7e58ac4-1d26-4454-9f8f-3986b679dff4 tempest-VolumesNegativeTest-1242424507 tempest-VolumesNegativeTest-1242424507-project] Calling method '.version_select at 0x7fd0e1144040>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:32:51.512861 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.wsgi [None req-c7e58ac4-1d26-4454-9f8f-3986b679dff4 tempest-VolumesNegativeTest-1242424507 tempest-VolumesNegativeTest-1242424507-project] HTTP exception thrown: Volume 43baf63e-5d19-4d27-895f-7d57346fa8a1 could not be found. Jun 30 12:32:51.515921 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-c7e58ac4-1d26-4454-9f8f-3986b679dff4 tempest-VolumesNegativeTest-1242424507 tempest-VolumesNegativeTest-1242424507-project] Request method failure captured: Jun 30 12:32:51.515921 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: request: GET /compute/v2.1/os-volumes/43baf63e-5d19-4d27-895f-7d57346fa8a1 HTTP/1.1 Jun 30 12:32:51.515921 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Accept: application/json Jun 30 12:32:51.515921 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Accept-Encoding: identity Jun 30 12:32:51.515921 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Connection: close Jun 30 12:32:51.515921 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Content-Length: 0 Jun 30 12:32:51.515921 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Content-Type: application/json Jun 30 12:32:51.515921 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Host: 10.222.0.57 Jun 30 12:32:51.515921 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Openstack-System-Scope: None Jun 30 12:32:51.515921 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: User-Agent: python-urllib3/1.26.9 Jun 30 12:32:51.515921 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Auth-Token: gAAAAABivZfvKeTp1XWM4JR1UZnVkzJRz090RdiWE-Ms-eqr1E8-T4eLIY0Cn3CsPu8o3IxtKvTROsKpANawNeVgQE6U9hmyZGj8EWVOF_g1q8Nk2OvfPRXaU5KdGnynsxqIOScK4QoZoLrLGbYYe02fyp3vVa-zmijUGDJ1bAIUO52_Lxg2E5Q Jun 30 12:32:51.515921 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Domain-Id: None Jun 30 12:32:51.515921 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Domain-Name: None Jun 30 12:32:51.515921 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Identity-Status: Confirmed Jun 30 12:32:51.515921 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Is-Admin-Project: True Jun 30 12:32:51.515921 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Project-Domain-Id: default Jun 30 12:32:51.515921 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Project-Domain-Name: Default Jun 30 12:32:51.515921 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Project-Id: e39c3bfdb43441b1a6241f5d926b62be Jun 30 12:32:51.515921 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Project-Name: tempest-VolumesNegativeTest-1242424507 Jun 30 12:32:51.515921 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Role: member,reader Jun 30 12:32:51.515921 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Roles: member,reader Jun 30 12:32:51.517336 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/e39c3bfdb43441b1a6241f5d926b62be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e39c3bfdb43441b1a6241f5d926b62be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_e39c3bfdb43441b1a6241f5d926b62be", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e39c3bfdb43441b1a6241f5d926b62be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 30 12:32:51.517336 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Tenant: tempest-VolumesNegativeTest-1242424507 Jun 30 12:32:51.517336 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Tenant-Id: e39c3bfdb43441b1a6241f5d926b62be Jun 30 12:32:51.517336 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Tenant-Name: tempest-VolumesNegativeTest-1242424507 Jun 30 12:32:51.517336 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User: tempest-VolumesNegativeTest-1242424507-project Jun 30 12:32:51.517336 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User-Domain-Id: default Jun 30 12:32:51.517336 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User-Domain-Name: Default Jun 30 12:32:51.517336 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User-Id: 04b8b5e97ba6419c999201b8699d0c47 Jun 30 12:32:51.517336 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User-Name: tempest-VolumesNegativeTest-1242424507-project Jun 30 12:32:51.517336 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: method: Jun 30 12:32:51.517336 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: exception: Volume 43baf63e-5d19-4d27-895f-7d57346fa8a1 could not be found. Jun 30 12:32:51.517336 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: action_args: {'id': '43baf63e-5d19-4d27-895f-7d57346fa8a1'} Jun 30 12:32:51.517336 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 12:32:51.518085 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:32:51.518085 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 12:32:51.518085 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 12:32:51.518085 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 30 12:32:51.518085 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 30 12:32:51.518085 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 30 12:32:51.518085 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 30 12:32:51.518085 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 30 12:32:51.518085 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 30 12:32:51.518085 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 30 12:32:51.518085 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 30 12:32:51.518085 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 12:32:51.518085 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 12:32:51.518085 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 12:32:51.518085 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 12:32:51.518085 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 43baf63e-5d19-4d27-895f-7d57346fa8a1 could not be found. (HTTP 404) (Request-ID: req-6405a098-b692-4e2c-80be-77ed1ea4f2d7) Jun 30 12:32:51.518085 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:32:51.518085 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:32:51.518085 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:32:51.519192 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:32:51.519192 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 30 12:32:51.519192 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 30 12:32:51.519192 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 30 12:32:51.519192 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 30 12:32:51.519192 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 30 12:32:51.519192 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 30 12:32:51.519192 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 30 12:32:51.519192 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 30 12:32:51.519192 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 12:32:51.519192 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 12:32:51.519192 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 30 12:32:51.519192 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 30 12:32:51.519192 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 30 12:32:51.519192 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 30 12:32:51.519192 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 30 12:32:51.519192 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 30 12:32:51.519192 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 30 12:32:51.519192 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 30 12:32:51.520262 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 12:32:51.520262 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 12:32:51.520262 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 12:32:51.520262 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 12:32:51.520262 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 43baf63e-5d19-4d27-895f-7d57346fa8a1 could not be found. Jun 30 12:32:51.520262 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:32:51.520262 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:32:51.520262 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:32:51.520262 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:32:51.520262 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:32:51.520262 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:32:51.520262 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 12:32:51.520262 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 12:32:51.520262 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 30 12:32:51.520262 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 30 12:32:51.520262 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 12:32:51.520262 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 12:32:51.520262 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 30 12:32:51.520262 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 12:32:51.521480 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 43baf63e-5d19-4d27-895f-7d57346fa8a1 could not be found. Jun 30 12:32:51.521480 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:32:51.521480 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:32:51.521480 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:32:51.521480 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:32:51.521480 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:32:51.521480 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:32:51.521480 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 12:32:51.521480 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 12:32:51.521480 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 43baf63e-5d19-4d27-895f-7d57346fa8a1 could not be found. Jun 30 12:32:51.521480 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:32:51.524371 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-c7e58ac4-1d26-4454-9f8f-3986b679dff4 tempest-VolumesNegativeTest-1242424507 tempest-VolumesNegativeTest-1242424507-project] Returning 404 to user: Volume 43baf63e-5d19-4d27-895f-7d57346fa8a1 could not be found. {{(pid=124297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 12:32:51.525497 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-c7e58ac4-1d26-4454-9f8f-3986b679dff4 tempest-VolumesNegativeTest-1242424507 tempest-VolumesNegativeTest-1242424507-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/43baf63e-5d19-4d27-895f-7d57346fa8a1" status: 404 len: 109 microversion: 2.1 time: 0.296618 Jun 30 12:32:51.526292 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 5/9] 10.222.0.57 () {58 vars in 1244 bytes} [Thu Jun 30 12:32:51 2022] GET /compute/v2.1/os-volumes/43baf63e-5d19-4d27-895f-7d57346fa8a1 => generated 109 bytes in 298 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 12:32:53.860620 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-1312b73d-44eb-44da-b04f-ec1d2e0e532b tempest-VolumesTestJSON-1749974804 tempest-VolumesTestJSON-1749974804-project] Calling method '.version_select at 0x7fd0e18f9d30>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:32:53.975326 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-1312b73d-44eb-44da-b04f-ec1d2e0e532b tempest-VolumesTestJSON-1749974804 tempest-VolumesTestJSON-1749974804-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/096020ee-d826-41dd-ac95-29df00674f86" status: 200 len: 351 microversion: 2.1 time: 0.140572 Jun 30 12:32:53.976700 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 5/10] 10.222.0.57 () {58 vars in 1244 bytes} [Thu Jun 30 12:32:53 2022] GET /compute/v2.1/os-volumes/096020ee-d826-41dd-ac95-29df00674f86 => generated 351 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:32:55.764477 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-76881ec4-aeff-4745-a60f-44898eeda114 tempest-VolumesTestJSON-1749974804 tempest-VolumesTestJSON-1749974804-project] Calling method '.version_select at 0x7fd0e102a040>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:32:55.890412 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-76881ec4-aeff-4745-a60f-44898eeda114 tempest-VolumesTestJSON-1749974804 tempest-VolumesTestJSON-1749974804-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/f419e3ca-0efc-4f5f-b66c-ab8c2244894b" status: 200 len: 351 microversion: 2.1 time: 0.130976 Jun 30 12:32:55.891465 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 6/11] 10.222.0.57 () {58 vars in 1244 bytes} [Thu Jun 30 12:32:55 2022] GET /compute/v2.1/os-volumes/f419e3ca-0efc-4f5f-b66c-ab8c2244894b => generated 351 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:32:55.902972 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-86a571e4-4482-4da3-bb6c-d091d0f5777e tempest-VolumesTestJSON-1749974804 tempest-VolumesTestJSON-1749974804-project] Calling method '.version_select at 0x7fd0e1033430>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:32:56.082821 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-86a571e4-4482-4da3-bb6c-d091d0f5777e tempest-VolumesTestJSON-1749974804 tempest-VolumesTestJSON-1749974804-project] 10.222.0.57 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.183716 Jun 30 12:32:56.083695 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 6/12] 10.222.0.57 () {58 vars in 1133 bytes} [Thu Jun 30 12:32:55 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:32:56.095742 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-09d54059-be46-4ef7-aa38-5a60d00d41de tempest-VolumesTestJSON-1749974804 tempest-VolumesTestJSON-1749974804-project] Calling method '.version_select at 0x7fd0e11440d0>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:32:56.280970 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-09d54059-be46-4ef7-aa38-5a60d00d41de tempest-VolumesTestJSON-1749974804 tempest-VolumesTestJSON-1749974804-project] 10.222.0.57 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.189295 Jun 30 12:32:56.281716 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 7/13] 10.222.0.57 () {58 vars in 1148 bytes} [Thu Jun 30 12:32:56 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:32:56.293488 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-b20369a3-18a2-4b59-8962-6da2310c3d7d tempest-VolumesTestJSON-1749974804 tempest-VolumesTestJSON-1749974804-project] Calling method '.version_select at 0x7fd0e10350d0>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:32:56.574455 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-b20369a3-18a2-4b59-8962-6da2310c3d7d tempest-VolumesTestJSON-1749974804 tempest-VolumesTestJSON-1749974804-project] 10.222.0.57 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.282939 Jun 30 12:32:56.575750 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 7/14] 10.222.0.57 () {58 vars in 1133 bytes} [Thu Jun 30 12:32:56 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:32:56.588342 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-5d4ab754-be47-47bb-b09a-11b5b6899100 tempest-VolumesTestJSON-1749974804 tempest-VolumesTestJSON-1749974804-project] Calling method '.version_select at 0x7fd0e102a5e0>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:32:56.746568 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-5d4ab754-be47-47bb-b09a-11b5b6899100 tempest-VolumesTestJSON-1749974804 tempest-VolumesTestJSON-1749974804-project] 10.222.0.57 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.163227 Jun 30 12:32:56.747644 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 8/15] 10.222.0.57 () {58 vars in 1166 bytes} [Thu Jun 30 12:32:56 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:32:56.760786 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-e3fd6421-b9f4-431d-872c-be6f2dec251a tempest-VolumesTestJSON-1749974804 tempest-VolumesTestJSON-1749974804-project] Calling method '.version_select at 0x7fd0e1035d30>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:32:56.943812 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-e3fd6421-b9f4-431d-872c-be6f2dec251a tempest-VolumesTestJSON-1749974804 tempest-VolumesTestJSON-1749974804-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.187734 Jun 30 12:32:56.944884 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 8/16] 10.222.0.57 () {58 vars in 1169 bytes} [Thu Jun 30 12:32:56 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:32:56.957840 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-077411c2-6a9f-4432-9349-466c4d3796d3 tempest-VolumesTestJSON-1749974804 tempest-VolumesTestJSON-1749974804-project] Calling method '.version_select at 0x7fd0e1035670>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:32:57.175957 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-077411c2-6a9f-4432-9349-466c4d3796d3 tempest-VolumesTestJSON-1749974804 tempest-VolumesTestJSON-1749974804-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.222757 Jun 30 12:32:57.176542 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 9/17] 10.222.0.57 () {58 vars in 1154 bytes} [Thu Jun 30 12:32:56 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 12:32:57.189035 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-1c9aa953-b7f7-4468-9f13-5ff5c019db76 tempest-VolumesTestJSON-1749974804 tempest-VolumesTestJSON-1749974804-project] Calling method '.version_select at 0x7fd0e1033ca0>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:32:57.358630 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-1c9aa953-b7f7-4468-9f13-5ff5c019db76 tempest-VolumesTestJSON-1749974804 tempest-VolumesTestJSON-1749974804-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.174091 Jun 30 12:32:57.364753 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 10/18] 10.222.0.57 () {58 vars in 1187 bytes} [Thu Jun 30 12:32:57 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:32:57.374423 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-7215f279-f86b-4209-a3cc-fdfa9d68ee81 tempest-VolumesTestJSON-1749974804 tempest-VolumesTestJSON-1749974804-project] Calling method '.version_select at 0x7fd0e11d83a0>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:32:57.553252 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-7215f279-f86b-4209-a3cc-fdfa9d68ee81 tempest-VolumesTestJSON-1749974804 tempest-VolumesTestJSON-1749974804-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.183976 Jun 30 12:32:57.554071 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 11/19] 10.222.0.57 () {58 vars in 1154 bytes} [Thu Jun 30 12:32:57 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 12:32:57.833916 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-91c0aa48-086c-4911-b470-6da3c4ec1a0a tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Action: 'create', calling method: .version_select at 0x7fd0e107be50>, body: {"keypair": {"name": "tempest-keypair-13269952", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE4jWN1iLLEHJ7TCozRCwOrXeYvFVI+cKkGQodgXta2RAWNJD2zJMh42n9P9c11q7W1W0PcCOqz2VJ1uq5pXKSG8aMTvJjX03IzBtsGq3eo2RY/FCBKUa5Kum/cDPxEVnA=="}} {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:32:57.930350 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.quota [None req-91c0aa48-086c-4911-b470-6da3c4ec1a0a tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Getting quotas for project b60d10dba1d947cc97149a063a810129. Resources: {'key_pairs'} {{(pid=124297) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 12:32:57.953455 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.quota [None req-91c0aa48-086c-4911-b470-6da3c4ec1a0a tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Getting quotas for user 6ddb38b4d6864a6c96b84c9a4092eea8 and project b60d10dba1d947cc97149a063a810129. Resources: {'key_pairs'} {{(pid=124297) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 12:32:58.075271 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-91c0aa48-086c-4911-b470-6da3c4ec1a0a tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 1.270445 Jun 30 12:32:58.083002 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 9/20] 10.222.0.57 () {60 vars in 1158 bytes} [Thu Jun 30 12:32:56 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:33:02.091027 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-10a4cab6-ede7-4c64-9a93-15e267af9369 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1998426876", "imageRef": "776a1662-a241-4e20-9a9c-e4743c64efd0", "flavorRef": "452", "networks": [{"uuid": "4e82b786-a83d-41e3-8c40-ed14c7ba1540"}]}} {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:33:02.338716 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.network.neutron [None req-10a4cab6-ede7-4c64-9a93-15e267af9369 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] validate_networks() for [('4e82b786-a83d-41e3-8c40-ed14c7ba1540', None, None, None, None, None)] {{(pid=124298) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 12:33:04.405229 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-f5230684-9735-49ab-b836-be3953b4a357 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1860992617", "imageRef": "776a1662-a241-4e20-9a9c-e4743c64efd0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:33:04.619853 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.network.neutron [None req-f5230684-9735-49ab-b836-be3953b4a357 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] validate_networks() for [('62ff37ac-5e15-467a-9aa0-136aed787f31', None, None, None, None, None)] {{(pid=124297) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 12:33:05.433641 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.virt.hardware [None req-10a4cab6-ede7-4c64-9a93-15e267af9369 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Flavor limits 0:0:0 {{(pid=124298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 12:33:05.434226 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.virt.hardware [None req-10a4cab6-ede7-4c64-9a93-15e267af9369 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Image limits 0:0:0 {{(pid=124298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 12:33:05.434546 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.virt.hardware [None req-10a4cab6-ede7-4c64-9a93-15e267af9369 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Flavor pref 0:0:0 {{(pid=124298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 12:33:05.434951 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.virt.hardware [None req-10a4cab6-ede7-4c64-9a93-15e267af9369 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Image pref 0:0:0 {{(pid=124298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 12:33:05.435359 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.virt.hardware [None req-10a4cab6-ede7-4c64-9a93-15e267af9369 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 12:33:05.450780 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-10a4cab6-ede7-4c64-9a93-15e267af9369 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:05.451587 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-10a4cab6-ede7-4c64-9a93-15e267af9369 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:05.452965 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-10a4cab6-ede7-4c64-9a93-15e267af9369 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:05.453644 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-10a4cab6-ede7-4c64-9a93-15e267af9369 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:05.520263 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.quota [None req-10a4cab6-ede7-4c64-9a93-15e267af9369 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Getting quotas for project 8fe4f134e4084a878a5e5cf59d96630f. Resources: {'cores', 'ram', 'instances'} {{(pid=124298) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 12:33:05.531740 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.quota [None req-10a4cab6-ede7-4c64-9a93-15e267af9369 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Getting quotas for user 3b688425466947198520ec7554bb49f7 and project 8fe4f134e4084a878a5e5cf59d96630f. Resources: {'cores', 'ram', 'instances'} {{(pid=124298) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 12:33:05.574705 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-10a4cab6-ede7-4c64-9a93-15e267af9369 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Going to run 1 instances... {{(pid=124298) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 12:33:05.579363 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-10a4cab6-ede7-4c64-9a93-15e267af9369 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] [instance: 13f18862-cd59-44c8-a5c7-08d003e51e26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='776a1662-a241-4e20-9a9c-e4743c64efd0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124298) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 12:33:05.802243 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-10a4cab6-ede7-4c64-9a93-15e267af9369 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.306800 Jun 30 12:33:05.818176 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 12/21] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 30 12:33:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 4322 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 12:33:05.853353 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-fbb8475e-84ff-4948-8c39-3585889f747f tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1505874439", "imageRef": "776a1662-a241-4e20-9a9c-e4743c64efd0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "36b59ef7-ad33-4935-9d99-c2dc624851fa"}], "security_groups": [{"name": "tempest-securitygroup--698277095"}], "key_name": "tempest-keypair-13269952", "user_data": "}} {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:33:06.285956 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.network.neutron [None req-fbb8475e-84ff-4948-8c39-3585889f747f tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] validate_networks() for [('36b59ef7-ad33-4935-9d99-c2dc624851fa', None, None, None, None, None)] {{(pid=124298) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 12:33:07.229601 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.virt.hardware [None req-f5230684-9735-49ab-b836-be3953b4a357 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Flavor limits 0:0:0 {{(pid=124297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 12:33:07.231208 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.virt.hardware [None req-f5230684-9735-49ab-b836-be3953b4a357 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Image limits 0:0:0 {{(pid=124297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 12:33:07.231941 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.virt.hardware [None req-f5230684-9735-49ab-b836-be3953b4a357 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Flavor pref 0:0:0 {{(pid=124297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 12:33:07.233451 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.virt.hardware [None req-f5230684-9735-49ab-b836-be3953b4a357 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Image pref 0:0:0 {{(pid=124297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 12:33:07.234268 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.virt.hardware [None req-f5230684-9735-49ab-b836-be3953b4a357 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 12:33:07.245585 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-f5230684-9735-49ab-b836-be3953b4a357 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:07.246270 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-f5230684-9735-49ab-b836-be3953b4a357 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:07.248112 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-f5230684-9735-49ab-b836-be3953b4a357 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:07.248877 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-f5230684-9735-49ab-b836-be3953b4a357 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:07.302044 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.quota [None req-f5230684-9735-49ab-b836-be3953b4a357 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Getting quotas for project 663ec7a59bc147299f904d93d119c5e7. Resources: {'cores', 'ram', 'instances'} {{(pid=124297) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 12:33:07.313783 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.quota [None req-f5230684-9735-49ab-b836-be3953b4a357 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Getting quotas for user 26807e5e7aab425eb28e781289794265 and project 663ec7a59bc147299f904d93d119c5e7. Resources: {'cores', 'ram', 'instances'} {{(pid=124297) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 12:33:07.363240 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-f5230684-9735-49ab-b836-be3953b4a357 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Going to run 1 instances... {{(pid=124297) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 12:33:07.391599 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-f5230684-9735-49ab-b836-be3953b4a357 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: 99a31213-cbcb-4b2c-b07f-ab67e78a2096] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='776a1662-a241-4e20-9a9c-e4743c64efd0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124297) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 12:33:07.683540 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-f5230684-9735-49ab-b836-be3953b4a357 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.931798 Jun 30 12:33:07.684200 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 10/22] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 30 12:33:03 2022] POST /compute/v2.1/servers => generated 383 bytes in 3933 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 12:33:07.689848 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-61187aae-d810-4ec5-b42f-65330db6aeaa tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:07.690464 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-61187aae-d810-4ec5-b42f-65330db6aeaa tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] [instance: 13f18862-cd59-44c8-a5c7-08d003e51e26] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:08.050094 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-61187aae-d810-4ec5-b42f-65330db6aeaa tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b688425466947198520ec7554bb49f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe4f134e4084a878a5e5cf59d96630f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:08.074757 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-61187aae-d810-4ec5-b42f-65330db6aeaa tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] 10.222.0.57 "GET /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26" status: 200 len: 1215 microversion: 2.1 time: 0.389272 Jun 30 12:33:08.084836 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 11/23] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:07 2022] GET /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26 => generated 1215 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:33:08.093944 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-2192e9b9-96be-403e-8b55-f1a5bee6fef6 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:08.094570 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-2192e9b9-96be-403e-8b55-f1a5bee6fef6 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: 99a31213-cbcb-4b2c-b07f-ab67e78a2096] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:08.109374 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.virt.hardware [None req-fbb8475e-84ff-4948-8c39-3585889f747f tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Flavor limits 0:0:0 {{(pid=124298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 12:33:08.110247 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.virt.hardware [None req-fbb8475e-84ff-4948-8c39-3585889f747f tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Image limits 0:0:0 {{(pid=124298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 12:33:08.110955 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.virt.hardware [None req-fbb8475e-84ff-4948-8c39-3585889f747f tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Flavor pref 0:0:0 {{(pid=124298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 12:33:08.111760 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.virt.hardware [None req-fbb8475e-84ff-4948-8c39-3585889f747f tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Image pref 0:0:0 {{(pid=124298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 12:33:08.112482 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.virt.hardware [None req-fbb8475e-84ff-4948-8c39-3585889f747f tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 12:33:08.141052 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-fbb8475e-84ff-4948-8c39-3585889f747f tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:08.143366 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-fbb8475e-84ff-4948-8c39-3585889f747f tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:08.147345 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-fbb8475e-84ff-4948-8c39-3585889f747f tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:08.148415 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-fbb8475e-84ff-4948-8c39-3585889f747f tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:08.196637 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.quota [None req-fbb8475e-84ff-4948-8c39-3585889f747f tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Getting quotas for project b60d10dba1d947cc97149a063a810129. Resources: {'cores', 'ram', 'instances'} {{(pid=124298) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 12:33:08.205338 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.quota [None req-fbb8475e-84ff-4948-8c39-3585889f747f tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Getting quotas for user 6ddb38b4d6864a6c96b84c9a4092eea8 and project b60d10dba1d947cc97149a063a810129. Resources: {'cores', 'ram', 'instances'} {{(pid=124298) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 12:33:08.226765 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-fbb8475e-84ff-4948-8c39-3585889f747f tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Going to run 1 instances... {{(pid=124298) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 12:33:08.229721 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-fbb8475e-84ff-4948-8c39-3585889f747f tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 99ba3b96-6700-41e0-b2cf-ff8933b2bf94] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='776a1662-a241-4e20-9a9c-e4743c64efd0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124298) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 12:33:08.280531 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-2192e9b9-96be-403e-8b55-f1a5bee6fef6 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:08.288738 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-2192e9b9-96be-403e-8b55-f1a5bee6fef6 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/99a31213-cbcb-4b2c-b07f-ab67e78a2096" status: 200 len: 1222 microversion: 2.1 time: 0.208236 Jun 30 12:33:08.298848 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-fbb8475e-84ff-4948-8c39-3585889f747f tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.473131 Jun 30 12:33:08.299854 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 12/24] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:08 2022] GET /compute/v2.1/servers/99a31213-cbcb-4b2c-b07f-ab67e78a2096 => generated 1222 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:33:08.300271 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 13/25] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 30 12:33:05 2022] POST /compute/v2.1/servers => generated 401 bytes in 2482 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 12:33:08.324337 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-315e43f0-1b02-4e74-8ca0-b536eed5c24a tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:08.327062 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-315e43f0-1b02-4e74-8ca0-b536eed5c24a tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 99ba3b96-6700-41e0-b2cf-ff8933b2bf94] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:08.479944 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-315e43f0-1b02-4e74-8ca0-b536eed5c24a tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddb38b4d6864a6c96b84c9a4092eea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60d10dba1d947cc97149a063a810129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:08.489856 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-315e43f0-1b02-4e74-8ca0-b536eed5c24a tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94" status: 200 len: 1236 microversion: 2.1 time: 0.183112 Jun 30 12:33:08.494540 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 13/26] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:08 2022] GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94 => generated 1236 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:33:08.709022 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-cb823594-c383-4754-8c21-6500568d0311 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1395706608", "imageRef": "776a1662-a241-4e20-9a9c-e4743c64efd0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:33:08.867133 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.network.neutron [None req-cb823594-c383-4754-8c21-6500568d0311 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] validate_networks() for [('62ff37ac-5e15-467a-9aa0-136aed787f31', None, None, None, None, None)] {{(pid=124298) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 12:33:09.091419 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-024e5aee-e642-4075-9a66-f54143e3faae tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:09.094604 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-024e5aee-e642-4075-9a66-f54143e3faae tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] [instance: 13f18862-cd59-44c8-a5c7-08d003e51e26] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:09.106384 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-024e5aee-e642-4075-9a66-f54143e3faae tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:09.106990 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-024e5aee-e642-4075-9a66-f54143e3faae tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:09.121080 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-024e5aee-e642-4075-9a66-f54143e3faae tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:09.126826 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-024e5aee-e642-4075-9a66-f54143e3faae tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:09.832465 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-024e5aee-e642-4075-9a66-f54143e3faae tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b688425466947198520ec7554bb49f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe4f134e4084a878a5e5cf59d96630f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:09.875786 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-024e5aee-e642-4075-9a66-f54143e3faae tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] 10.222.0.57 "GET /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26" status: 200 len: 1219 microversion: 2.1 time: 0.784400 Jun 30 12:33:09.879626 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 14/27] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:09 2022] GET /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26 => generated 1219 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 12:33:09.890980 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-72485b67-9d4a-4d38-b5c1-6e4cd85d31ec tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:09.896107 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-72485b67-9d4a-4d38-b5c1-6e4cd85d31ec tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 99ba3b96-6700-41e0-b2cf-ff8933b2bf94] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:09.911349 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-72485b67-9d4a-4d38-b5c1-6e4cd85d31ec tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:09.914012 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-72485b67-9d4a-4d38-b5c1-6e4cd85d31ec tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:09.915203 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-72485b67-9d4a-4d38-b5c1-6e4cd85d31ec tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:09.915859 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-72485b67-9d4a-4d38-b5c1-6e4cd85d31ec tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:09.970116 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.virt.hardware [None req-cb823594-c383-4754-8c21-6500568d0311 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Flavor limits 0:0:0 {{(pid=124298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 12:33:09.970746 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.virt.hardware [None req-cb823594-c383-4754-8c21-6500568d0311 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Image limits 0:0:0 {{(pid=124298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 12:33:09.971279 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.virt.hardware [None req-cb823594-c383-4754-8c21-6500568d0311 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Flavor pref 0:0:0 {{(pid=124298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 12:33:09.971876 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.virt.hardware [None req-cb823594-c383-4754-8c21-6500568d0311 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Image pref 0:0:0 {{(pid=124298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 12:33:09.972478 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.virt.hardware [None req-cb823594-c383-4754-8c21-6500568d0311 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 12:33:09.989223 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-cb823594-c383-4754-8c21-6500568d0311 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:09.989675 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-cb823594-c383-4754-8c21-6500568d0311 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:09.990624 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-cb823594-c383-4754-8c21-6500568d0311 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:09.991067 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-cb823594-c383-4754-8c21-6500568d0311 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:10.010144 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.quota [None req-cb823594-c383-4754-8c21-6500568d0311 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Getting quotas for project 663ec7a59bc147299f904d93d119c5e7. Resources: {'cores', 'ram', 'instances'} {{(pid=124298) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 12:33:10.010571 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-72485b67-9d4a-4d38-b5c1-6e4cd85d31ec tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddb38b4d6864a6c96b84c9a4092eea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60d10dba1d947cc97149a063a810129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:10.014999 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.quota [None req-cb823594-c383-4754-8c21-6500568d0311 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Getting quotas for user 26807e5e7aab425eb28e781289794265 and project 663ec7a59bc147299f904d93d119c5e7. Resources: {'cores', 'ram', 'instances'} {{(pid=124298) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 12:33:10.020312 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-72485b67-9d4a-4d38-b5c1-6e4cd85d31ec tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94" status: 200 len: 1240 microversion: 2.1 time: 0.139106 Jun 30 12:33:10.022456 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 15/28] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:09 2022] GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94 => generated 1240 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:33:10.036742 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-cb823594-c383-4754-8c21-6500568d0311 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Going to run 1 instances... {{(pid=124298) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 12:33:10.039295 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-cb823594-c383-4754-8c21-6500568d0311 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: a2fe3bb8-40b2-4dea-818a-083e0bc5fb61] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='776a1662-a241-4e20-9a9c-e4743c64efd0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124298) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 12:33:10.090843 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-cb823594-c383-4754-8c21-6500568d0311 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.386938 Jun 30 12:33:10.096281 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 14/29] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 30 12:33:08 2022] POST /compute/v2.1/servers => generated 383 bytes in 1388 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 12:33:10.102043 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-5b3f0839-229e-447f-9a20-2c8d4b88b54f tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:10.103313 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-5b3f0839-229e-447f-9a20-2c8d4b88b54f tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: a2fe3bb8-40b2-4dea-818a-083e0bc5fb61] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:10.207412 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-5b3f0839-229e-447f-9a20-2c8d4b88b54f tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:10.217836 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-5b3f0839-229e-447f-9a20-2c8d4b88b54f tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61" status: 200 len: 1222 microversion: 2.1 time: 0.119911 Jun 30 12:33:10.221291 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 16/30] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:10 2022] GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61 => generated 1222 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:33:10.896705 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-fd4aee8a-48d0-487e-aec3-606482bb9f1d tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:10.897331 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-fd4aee8a-48d0-487e-aec3-606482bb9f1d tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] [instance: 13f18862-cd59-44c8-a5c7-08d003e51e26] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:10.910224 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-fd4aee8a-48d0-487e-aec3-606482bb9f1d tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:10.910674 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-fd4aee8a-48d0-487e-aec3-606482bb9f1d tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:10.911673 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-fd4aee8a-48d0-487e-aec3-606482bb9f1d tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:10.912300 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-fd4aee8a-48d0-487e-aec3-606482bb9f1d tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:11.040711 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-a2b9af41-ab39-4c87-91d2-abd8502c342c tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:11.042016 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-a2b9af41-ab39-4c87-91d2-abd8502c342c tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 99ba3b96-6700-41e0-b2cf-ff8933b2bf94] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:11.049931 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-a2b9af41-ab39-4c87-91d2-abd8502c342c tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:11.050566 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-a2b9af41-ab39-4c87-91d2-abd8502c342c tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:11.051382 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-a2b9af41-ab39-4c87-91d2-abd8502c342c tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:11.051814 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-a2b9af41-ab39-4c87-91d2-abd8502c342c tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:11.052107 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-fd4aee8a-48d0-487e-aec3-606482bb9f1d tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b688425466947198520ec7554bb49f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe4f134e4084a878a5e5cf59d96630f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:11.066305 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-fd4aee8a-48d0-487e-aec3-606482bb9f1d tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] 10.222.0.57 "GET /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26" status: 200 len: 1211 microversion: 2.1 time: 0.173355 Jun 30 12:33:11.067221 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 15/31] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:10 2022] GET /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26 => generated 1211 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:33:11.116687 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-a2b9af41-ab39-4c87-91d2-abd8502c342c tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddb38b4d6864a6c96b84c9a4092eea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60d10dba1d947cc97149a063a810129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:11.124866 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-a2b9af41-ab39-4c87-91d2-abd8502c342c tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94" status: 200 len: 1240 microversion: 2.1 time: 0.089100 Jun 30 12:33:11.125357 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 17/32] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:11 2022] GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94 => generated 1240 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:33:11.235956 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-4aad58aa-7f58-4f4c-a6b2-3eea12c3a661 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:11.236570 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-4aad58aa-7f58-4f4c-a6b2-3eea12c3a661 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: a2fe3bb8-40b2-4dea-818a-083e0bc5fb61] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:11.242920 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-4aad58aa-7f58-4f4c-a6b2-3eea12c3a661 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:11.243371 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-4aad58aa-7f58-4f4c-a6b2-3eea12c3a661 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:11.244311 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-4aad58aa-7f58-4f4c-a6b2-3eea12c3a661 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:11.244747 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-4aad58aa-7f58-4f4c-a6b2-3eea12c3a661 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:11.310016 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-4aad58aa-7f58-4f4c-a6b2-3eea12c3a661 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:11.317394 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-4aad58aa-7f58-4f4c-a6b2-3eea12c3a661 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61" status: 200 len: 1226 microversion: 2.1 time: 0.085786 Jun 30 12:33:11.318052 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 16/33] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:11 2022] GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:33:12.083655 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-42030284-7891-4f7d-9035-e8542dbd308e tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:12.084276 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-42030284-7891-4f7d-9035-e8542dbd308e tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] [instance: 13f18862-cd59-44c8-a5c7-08d003e51e26] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:12.091887 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-42030284-7891-4f7d-9035-e8542dbd308e tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:12.092342 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-42030284-7891-4f7d-9035-e8542dbd308e tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:12.093216 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-42030284-7891-4f7d-9035-e8542dbd308e tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:12.093654 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-42030284-7891-4f7d-9035-e8542dbd308e tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:12.141685 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-911bbf90-6b30-4a14-8e1b-0798dbc88593 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:12.142300 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-911bbf90-6b30-4a14-8e1b-0798dbc88593 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 99ba3b96-6700-41e0-b2cf-ff8933b2bf94] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:12.148393 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-911bbf90-6b30-4a14-8e1b-0798dbc88593 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:12.149096 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-911bbf90-6b30-4a14-8e1b-0798dbc88593 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:12.150028 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-911bbf90-6b30-4a14-8e1b-0798dbc88593 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:12.150751 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-911bbf90-6b30-4a14-8e1b-0798dbc88593 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:12.161325 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-42030284-7891-4f7d-9035-e8542dbd308e tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b688425466947198520ec7554bb49f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe4f134e4084a878a5e5cf59d96630f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:12.170675 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-42030284-7891-4f7d-9035-e8542dbd308e tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] 10.222.0.57 "GET /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26" status: 200 len: 1211 microversion: 2.1 time: 0.090774 Jun 30 12:33:12.172029 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 18/34] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:12 2022] GET /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26 => generated 1211 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:33:12.226739 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-911bbf90-6b30-4a14-8e1b-0798dbc88593 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddb38b4d6864a6c96b84c9a4092eea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60d10dba1d947cc97149a063a810129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:12.234437 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-911bbf90-6b30-4a14-8e1b-0798dbc88593 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94" status: 200 len: 1240 microversion: 2.1 time: 0.096759 Jun 30 12:33:12.235064 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 17/35] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:12 2022] GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94 => generated 1240 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 12:33:12.334959 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-20a90c6c-b733-4848-a507-c2a5480b3e55 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:12.335988 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-20a90c6c-b733-4848-a507-c2a5480b3e55 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: a2fe3bb8-40b2-4dea-818a-083e0bc5fb61] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:12.342955 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-20a90c6c-b733-4848-a507-c2a5480b3e55 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:12.343709 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-20a90c6c-b733-4848-a507-c2a5480b3e55 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:12.344853 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-20a90c6c-b733-4848-a507-c2a5480b3e55 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:12.345594 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-20a90c6c-b733-4848-a507-c2a5480b3e55 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:12.441257 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-20a90c6c-b733-4848-a507-c2a5480b3e55 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:12.470447 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-20a90c6c-b733-4848-a507-c2a5480b3e55 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61" status: 200 len: 1226 microversion: 2.1 time: 0.139460 Jun 30 12:33:12.471051 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 19/36] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:12 2022] GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61 => generated 1226 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:33:13.189727 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-e93a8e6c-9fb6-415c-b47a-f34f92f99d7b tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:13.191001 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-e93a8e6c-9fb6-415c-b47a-f34f92f99d7b tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] [instance: 13f18862-cd59-44c8-a5c7-08d003e51e26] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:13.201326 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-e93a8e6c-9fb6-415c-b47a-f34f92f99d7b tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:13.202159 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-e93a8e6c-9fb6-415c-b47a-f34f92f99d7b tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:13.203161 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-e93a8e6c-9fb6-415c-b47a-f34f92f99d7b tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:13.203863 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-e93a8e6c-9fb6-415c-b47a-f34f92f99d7b tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:13.255356 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-e704d990-5fbf-4848-8550-ad4f93100aa4 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:13.258775 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-e704d990-5fbf-4848-8550-ad4f93100aa4 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 99ba3b96-6700-41e0-b2cf-ff8933b2bf94] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:13.276826 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-e704d990-5fbf-4848-8550-ad4f93100aa4 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:13.279294 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-e704d990-5fbf-4848-8550-ad4f93100aa4 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:13.283465 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-e704d990-5fbf-4848-8550-ad4f93100aa4 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:13.285197 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-e704d990-5fbf-4848-8550-ad4f93100aa4 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:13.367074 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-e93a8e6c-9fb6-415c-b47a-f34f92f99d7b tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b688425466947198520ec7554bb49f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe4f134e4084a878a5e5cf59d96630f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:13.384904 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-e93a8e6c-9fb6-415c-b47a-f34f92f99d7b tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] 10.222.0.57 "GET /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26" status: 200 len: 1267 microversion: 2.1 time: 0.200934 Jun 30 12:33:13.385516 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 18/37] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:13 2022] GET /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26 => generated 1267 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:33:13.482015 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-e704d990-5fbf-4848-8550-ad4f93100aa4 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddb38b4d6864a6c96b84c9a4092eea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60d10dba1d947cc97149a063a810129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:13.487230 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-2534477f-a342-4b6b-97ab-ac4a610859e6 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:13.487857 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-2534477f-a342-4b6b-97ab-ac4a610859e6 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: a2fe3bb8-40b2-4dea-818a-083e0bc5fb61] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:13.503624 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-e704d990-5fbf-4848-8550-ad4f93100aa4 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94" status: 200 len: 1288 microversion: 2.1 time: 0.252691 Jun 30 12:33:13.504664 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-2534477f-a342-4b6b-97ab-ac4a610859e6 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:13.505308 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-2534477f-a342-4b6b-97ab-ac4a610859e6 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:13.506299 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 20/38] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:13 2022] GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94 => generated 1288 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:33:13.506914 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-2534477f-a342-4b6b-97ab-ac4a610859e6 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:13.507625 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-2534477f-a342-4b6b-97ab-ac4a610859e6 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:13.608282 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-2534477f-a342-4b6b-97ab-ac4a610859e6 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:13.619209 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-2534477f-a342-4b6b-97ab-ac4a610859e6 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61" status: 200 len: 1274 microversion: 2.1 time: 0.135607 Jun 30 12:33:13.620461 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 19/39] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:13 2022] GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61 => generated 1274 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:33:14.404446 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-7a17e3ac-d6fd-425a-ace7-2894e890b1fc tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:14.405967 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-7a17e3ac-d6fd-425a-ace7-2894e890b1fc tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] [instance: 13f18862-cd59-44c8-a5c7-08d003e51e26] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:14.433132 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-7a17e3ac-d6fd-425a-ace7-2894e890b1fc tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:14.435014 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-7a17e3ac-d6fd-425a-ace7-2894e890b1fc tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:14.437798 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-7a17e3ac-d6fd-425a-ace7-2894e890b1fc tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:14.438533 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-7a17e3ac-d6fd-425a-ace7-2894e890b1fc tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:14.519853 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-450c35bc-1890-45f5-8410-9591dbf2468c tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:14.520459 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-450c35bc-1890-45f5-8410-9591dbf2468c tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 99ba3b96-6700-41e0-b2cf-ff8933b2bf94] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:14.535476 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-450c35bc-1890-45f5-8410-9591dbf2468c tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:14.536682 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-450c35bc-1890-45f5-8410-9591dbf2468c tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:14.541772 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-450c35bc-1890-45f5-8410-9591dbf2468c tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:14.543332 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-450c35bc-1890-45f5-8410-9591dbf2468c tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:14.724533 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-7a17e3ac-d6fd-425a-ace7-2894e890b1fc tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b688425466947198520ec7554bb49f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe4f134e4084a878a5e5cf59d96630f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:14.777797 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-7a17e3ac-d6fd-425a-ace7-2894e890b1fc tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] 10.222.0.57 "GET /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26" status: 200 len: 1273 microversion: 2.1 time: 0.374917 Jun 30 12:33:14.787418 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 21/40] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:14 2022] GET /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26 => generated 1273 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:33:14.819834 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-45f49727-3ad0-48f4-8297-3c78c8a33560 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:14.824349 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-45f49727-3ad0-48f4-8297-3c78c8a33560 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: a2fe3bb8-40b2-4dea-818a-083e0bc5fb61] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:14.858934 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-45f49727-3ad0-48f4-8297-3c78c8a33560 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:14.859424 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-45f49727-3ad0-48f4-8297-3c78c8a33560 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:14.866483 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-45f49727-3ad0-48f4-8297-3c78c8a33560 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:14.869421 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-45f49727-3ad0-48f4-8297-3c78c8a33560 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:15.257312 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-450c35bc-1890-45f5-8410-9591dbf2468c tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddb38b4d6864a6c96b84c9a4092eea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60d10dba1d947cc97149a063a810129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:15.266273 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-450c35bc-1890-45f5-8410-9591dbf2468c tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94" status: 200 len: 1296 microversion: 2.1 time: 0.750168 Jun 30 12:33:15.270747 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 20/41] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:14 2022] GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94 => generated 1296 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:33:15.330562 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-45f49727-3ad0-48f4-8297-3c78c8a33560 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:15.338736 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-45f49727-3ad0-48f4-8297-3c78c8a33560 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61" status: 200 len: 1292 microversion: 2.1 time: 0.549035 Jun 30 12:33:15.339346 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 22/42] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:14 2022] GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61 => generated 1292 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:33:15.797116 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-a44f1db3-b19f-4d45-b5dd-30e76423bf91 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:15.798683 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-a44f1db3-b19f-4d45-b5dd-30e76423bf91 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] [instance: 13f18862-cd59-44c8-a5c7-08d003e51e26] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:15.807528 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-a44f1db3-b19f-4d45-b5dd-30e76423bf91 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:15.814215 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-a44f1db3-b19f-4d45-b5dd-30e76423bf91 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:15.815312 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-a44f1db3-b19f-4d45-b5dd-30e76423bf91 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:15.816102 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-a44f1db3-b19f-4d45-b5dd-30e76423bf91 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:15.938143 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-a44f1db3-b19f-4d45-b5dd-30e76423bf91 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b688425466947198520ec7554bb49f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe4f134e4084a878a5e5cf59d96630f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:15.947089 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-a44f1db3-b19f-4d45-b5dd-30e76423bf91 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] 10.222.0.57 "GET /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26" status: 200 len: 1273 microversion: 2.1 time: 0.154018 Jun 30 12:33:15.958921 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 21/43] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:15 2022] GET /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26 => generated 1273 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:33:16.293884 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-9b373bf4-66a6-49e1-8ae2-74bf5e3ef2a7 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:16.294658 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-9b373bf4-66a6-49e1-8ae2-74bf5e3ef2a7 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 99ba3b96-6700-41e0-b2cf-ff8933b2bf94] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:16.320431 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-9b373bf4-66a6-49e1-8ae2-74bf5e3ef2a7 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:16.321189 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-9b373bf4-66a6-49e1-8ae2-74bf5e3ef2a7 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:16.321886 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-9b373bf4-66a6-49e1-8ae2-74bf5e3ef2a7 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:16.322267 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-9b373bf4-66a6-49e1-8ae2-74bf5e3ef2a7 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:16.356229 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-871bb3ca-cb52-4aee-8fe0-9cba490d2ea3 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:16.357294 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-871bb3ca-cb52-4aee-8fe0-9cba490d2ea3 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: a2fe3bb8-40b2-4dea-818a-083e0bc5fb61] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:16.368130 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-871bb3ca-cb52-4aee-8fe0-9cba490d2ea3 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:16.373973 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-871bb3ca-cb52-4aee-8fe0-9cba490d2ea3 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:16.382968 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-871bb3ca-cb52-4aee-8fe0-9cba490d2ea3 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:16.382968 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-871bb3ca-cb52-4aee-8fe0-9cba490d2ea3 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:16.681948 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-9b373bf4-66a6-49e1-8ae2-74bf5e3ef2a7 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddb38b4d6864a6c96b84c9a4092eea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60d10dba1d947cc97149a063a810129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:16.691838 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-9b373bf4-66a6-49e1-8ae2-74bf5e3ef2a7 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94" status: 200 len: 1294 microversion: 2.1 time: 0.406622 Jun 30 12:33:16.702078 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 23/44] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:16 2022] GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94 => generated 1294 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:33:16.818973 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-871bb3ca-cb52-4aee-8fe0-9cba490d2ea3 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:16.829721 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-871bb3ca-cb52-4aee-8fe0-9cba490d2ea3 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61" status: 200 len: 1322 microversion: 2.1 time: 0.477455 Jun 30 12:33:16.830427 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 22/45] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:16 2022] GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61 => generated 1322 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:33:16.971623 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-ef3a89c1-3047-4cab-8777-906396cd1d55 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:16.972561 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-ef3a89c1-3047-4cab-8777-906396cd1d55 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] [instance: 13f18862-cd59-44c8-a5c7-08d003e51e26] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:16.979246 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-ef3a89c1-3047-4cab-8777-906396cd1d55 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:16.979827 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-ef3a89c1-3047-4cab-8777-906396cd1d55 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:16.980813 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-ef3a89c1-3047-4cab-8777-906396cd1d55 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:16.981248 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-ef3a89c1-3047-4cab-8777-906396cd1d55 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:17.119803 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-ef3a89c1-3047-4cab-8777-906396cd1d55 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b688425466947198520ec7554bb49f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe4f134e4084a878a5e5cf59d96630f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:17.127609 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-ef3a89c1-3047-4cab-8777-906396cd1d55 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] 10.222.0.57 "GET /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26" status: 200 len: 1315 microversion: 2.1 time: 0.163016 Jun 30 12:33:17.136676 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 24/46] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:16 2022] GET /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:33:17.710119 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-298f38eb-da66-4dca-8957-134db3f14ddd tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:17.710807 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-298f38eb-da66-4dca-8957-134db3f14ddd tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 99ba3b96-6700-41e0-b2cf-ff8933b2bf94] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:17.718013 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-298f38eb-da66-4dca-8957-134db3f14ddd tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:17.718859 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-298f38eb-da66-4dca-8957-134db3f14ddd tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:17.719876 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-298f38eb-da66-4dca-8957-134db3f14ddd tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:17.720730 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-298f38eb-da66-4dca-8957-134db3f14ddd tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:17.804398 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-298f38eb-da66-4dca-8957-134db3f14ddd tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddb38b4d6864a6c96b84c9a4092eea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60d10dba1d947cc97149a063a810129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:17.825447 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-298f38eb-da66-4dca-8957-134db3f14ddd tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94" status: 200 len: 1294 microversion: 2.1 time: 0.119623 Jun 30 12:33:17.837516 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 23/47] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:17 2022] GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94 => generated 1294 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:33:17.850842 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-8e897187-373e-40f2-af99-49d0c07a50ce tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:17.851612 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-8e897187-373e-40f2-af99-49d0c07a50ce tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: a2fe3bb8-40b2-4dea-818a-083e0bc5fb61] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:17.859757 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG dbcounter [-] [124297] Writing DB stats nova_cell0:SELECT=2 {{(pid=124297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:33:17.862338 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-8e897187-373e-40f2-af99-49d0c07a50ce tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:17.862898 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-8e897187-373e-40f2-af99-49d0c07a50ce tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:17.863761 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-8e897187-373e-40f2-af99-49d0c07a50ce tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:17.864203 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-8e897187-373e-40f2-af99-49d0c07a50ce tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:18.119177 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-8e897187-373e-40f2-af99-49d0c07a50ce tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:18.140579 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-8e897187-373e-40f2-af99-49d0c07a50ce tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61" status: 200 len: 1322 microversion: 2.1 time: 0.294049 Jun 30 12:33:18.143338 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 25/48] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:17 2022] GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61 => generated 1322 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:33:18.149505 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-e65c8de6-4de2-4992-867f-eec6912c5844 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:18.150443 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-e65c8de6-4de2-4992-867f-eec6912c5844 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] [instance: 13f18862-cd59-44c8-a5c7-08d003e51e26] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:18.177971 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-e65c8de6-4de2-4992-867f-eec6912c5844 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:18.178431 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-e65c8de6-4de2-4992-867f-eec6912c5844 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:18.183006 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-e65c8de6-4de2-4992-867f-eec6912c5844 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:18.183473 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-e65c8de6-4de2-4992-867f-eec6912c5844 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:18.393674 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-e65c8de6-4de2-4992-867f-eec6912c5844 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b688425466947198520ec7554bb49f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe4f134e4084a878a5e5cf59d96630f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:18.412439 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-e65c8de6-4de2-4992-867f-eec6912c5844 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] 10.222.0.57 "GET /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26" status: 200 len: 1315 microversion: 2.1 time: 0.269573 Jun 30 12:33:18.413359 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 24/49] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:18 2022] GET /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26 => generated 1315 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:33:18.846149 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-b5a0dcc0-2678-4517-9ada-7d53bcf9afe4 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:18.846676 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-b5a0dcc0-2678-4517-9ada-7d53bcf9afe4 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 99ba3b96-6700-41e0-b2cf-ff8933b2bf94] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:18.854420 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-b5a0dcc0-2678-4517-9ada-7d53bcf9afe4 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:18.855189 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-b5a0dcc0-2678-4517-9ada-7d53bcf9afe4 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:18.855631 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-b5a0dcc0-2678-4517-9ada-7d53bcf9afe4 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:18.857997 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-b5a0dcc0-2678-4517-9ada-7d53bcf9afe4 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:18.992594 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-b5a0dcc0-2678-4517-9ada-7d53bcf9afe4 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddb38b4d6864a6c96b84c9a4092eea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60d10dba1d947cc97149a063a810129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:19.009020 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-b5a0dcc0-2678-4517-9ada-7d53bcf9afe4 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94" status: 200 len: 1294 microversion: 2.1 time: 0.169147 Jun 30 12:33:19.019117 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 26/50] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:18 2022] GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94 => generated 1294 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:33:19.165738 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-ab122ab7-1614-4804-8ebe-664863ea8469 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:19.166396 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-ab122ab7-1614-4804-8ebe-664863ea8469 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: a2fe3bb8-40b2-4dea-818a-083e0bc5fb61] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:19.174480 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-ab122ab7-1614-4804-8ebe-664863ea8469 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:19.175191 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-ab122ab7-1614-4804-8ebe-664863ea8469 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:19.176272 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-ab122ab7-1614-4804-8ebe-664863ea8469 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:19.176782 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-ab122ab7-1614-4804-8ebe-664863ea8469 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:19.398547 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-ab122ab7-1614-4804-8ebe-664863ea8469 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:19.408671 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-ab122ab7-1614-4804-8ebe-664863ea8469 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61" status: 200 len: 1322 microversion: 2.1 time: 0.254345 Jun 30 12:33:19.428965 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 25/51] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:19 2022] GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61 => generated 1322 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:33:19.430719 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-fee3fc4d-bd7e-49a7-ae9d-86bb4a669e7b tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:19.431665 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-fee3fc4d-bd7e-49a7-ae9d-86bb4a669e7b tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] [instance: 13f18862-cd59-44c8-a5c7-08d003e51e26] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:19.439300 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-fee3fc4d-bd7e-49a7-ae9d-86bb4a669e7b tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:19.439835 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-fee3fc4d-bd7e-49a7-ae9d-86bb4a669e7b tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:19.440713 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-fee3fc4d-bd7e-49a7-ae9d-86bb4a669e7b tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:19.441239 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-fee3fc4d-bd7e-49a7-ae9d-86bb4a669e7b tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:19.605212 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-fee3fc4d-bd7e-49a7-ae9d-86bb4a669e7b tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b688425466947198520ec7554bb49f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe4f134e4084a878a5e5cf59d96630f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:19.617151 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-fee3fc4d-bd7e-49a7-ae9d-86bb4a669e7b tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] 10.222.0.57 "GET /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26" status: 200 len: 1315 microversion: 2.1 time: 0.190625 Jun 30 12:33:19.618551 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 27/52] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:19 2022] GET /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26 => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 12:33:20.026398 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-4c92dfa0-e801-4eec-9ffb-cffe5042d4cd tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:20.027013 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-4c92dfa0-e801-4eec-9ffb-cffe5042d4cd tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 99ba3b96-6700-41e0-b2cf-ff8933b2bf94] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:20.031018 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG dbcounter [-] [124298] Writing DB stats nova_cell0:SELECT=6 {{(pid=124298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:33:20.031679 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG dbcounter [-] [124298] Writing DB stats nova_cell0:SELECT=18 {{(pid=124298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:33:20.035654 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-4c92dfa0-e801-4eec-9ffb-cffe5042d4cd tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:20.036398 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-4c92dfa0-e801-4eec-9ffb-cffe5042d4cd tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:20.038273 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-4c92dfa0-e801-4eec-9ffb-cffe5042d4cd tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:20.038845 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-4c92dfa0-e801-4eec-9ffb-cffe5042d4cd tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:20.171720 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-4c92dfa0-e801-4eec-9ffb-cffe5042d4cd tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddb38b4d6864a6c96b84c9a4092eea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60d10dba1d947cc97149a063a810129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:20.199609 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-4c92dfa0-e801-4eec-9ffb-cffe5042d4cd tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94" status: 200 len: 1294 microversion: 2.1 time: 0.177105 Jun 30 12:33:20.203886 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 26/53] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:20 2022] GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94 => generated 1294 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:33:20.437693 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-d3ef5f37-1b51-43bd-bdff-94acd08cb3d0 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:20.438687 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-d3ef5f37-1b51-43bd-bdff-94acd08cb3d0 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: a2fe3bb8-40b2-4dea-818a-083e0bc5fb61] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:20.441369 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG dbcounter [-] [124297] Writing DB stats nova_cell0:SELECT=18 {{(pid=124297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:33:20.442870 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG dbcounter [-] [124297] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=4 {{(pid=124297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:33:20.457844 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-d3ef5f37-1b51-43bd-bdff-94acd08cb3d0 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:20.458651 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-d3ef5f37-1b51-43bd-bdff-94acd08cb3d0 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:20.460695 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-d3ef5f37-1b51-43bd-bdff-94acd08cb3d0 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:20.461348 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-d3ef5f37-1b51-43bd-bdff-94acd08cb3d0 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:20.640974 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-9cb5a217-e074-4ef0-b3fd-518ab8c410ce tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:20.642099 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-9cb5a217-e074-4ef0-b3fd-518ab8c410ce tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] [instance: 13f18862-cd59-44c8-a5c7-08d003e51e26] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:20.649720 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-9cb5a217-e074-4ef0-b3fd-518ab8c410ce tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:20.650343 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-9cb5a217-e074-4ef0-b3fd-518ab8c410ce tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:20.651316 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-9cb5a217-e074-4ef0-b3fd-518ab8c410ce tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:20.651923 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-9cb5a217-e074-4ef0-b3fd-518ab8c410ce tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:20.710164 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-d3ef5f37-1b51-43bd-bdff-94acd08cb3d0 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:20.720439 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-d3ef5f37-1b51-43bd-bdff-94acd08cb3d0 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61" status: 200 len: 1322 microversion: 2.1 time: 0.287840 Jun 30 12:33:20.721136 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 28/54] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:20 2022] GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61 => generated 1322 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:33:20.866410 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-9cb5a217-e074-4ef0-b3fd-518ab8c410ce tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b688425466947198520ec7554bb49f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe4f134e4084a878a5e5cf59d96630f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:20.875384 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-9cb5a217-e074-4ef0-b3fd-518ab8c410ce tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] 10.222.0.57 "GET /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26" status: 200 len: 1315 microversion: 2.1 time: 0.244488 Jun 30 12:33:20.875966 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 27/55] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:20 2022] GET /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26 => generated 1315 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 12:33:21.221971 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-aae23dd7-4556-4f23-afed-2969aea58d75 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:21.222681 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-aae23dd7-4556-4f23-afed-2969aea58d75 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 99ba3b96-6700-41e0-b2cf-ff8933b2bf94] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:21.229041 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-aae23dd7-4556-4f23-afed-2969aea58d75 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:21.229581 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-aae23dd7-4556-4f23-afed-2969aea58d75 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:21.230511 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-aae23dd7-4556-4f23-afed-2969aea58d75 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:21.230969 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-aae23dd7-4556-4f23-afed-2969aea58d75 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:21.308227 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-aae23dd7-4556-4f23-afed-2969aea58d75 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddb38b4d6864a6c96b84c9a4092eea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60d10dba1d947cc97149a063a810129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:21.316800 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-aae23dd7-4556-4f23-afed-2969aea58d75 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94" status: 200 len: 1294 microversion: 2.1 time: 0.098805 Jun 30 12:33:21.318255 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 29/56] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:21 2022] GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94 => generated 1294 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:33:21.739953 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-3d2d3ccf-25f8-4bd3-b7ac-90e02e29c390 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:21.740563 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-3d2d3ccf-25f8-4bd3-b7ac-90e02e29c390 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: a2fe3bb8-40b2-4dea-818a-083e0bc5fb61] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:21.749847 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-3d2d3ccf-25f8-4bd3-b7ac-90e02e29c390 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:21.750304 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-3d2d3ccf-25f8-4bd3-b7ac-90e02e29c390 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:21.751087 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-3d2d3ccf-25f8-4bd3-b7ac-90e02e29c390 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:21.751525 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-3d2d3ccf-25f8-4bd3-b7ac-90e02e29c390 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:21.892201 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-8060edb8-7ec9-406a-b2f3-842bd496dbd9 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:21.894516 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-8060edb8-7ec9-406a-b2f3-842bd496dbd9 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] [instance: 13f18862-cd59-44c8-a5c7-08d003e51e26] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:21.901874 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-8060edb8-7ec9-406a-b2f3-842bd496dbd9 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:21.902590 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-8060edb8-7ec9-406a-b2f3-842bd496dbd9 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:21.904978 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-8060edb8-7ec9-406a-b2f3-842bd496dbd9 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:21.905632 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-8060edb8-7ec9-406a-b2f3-842bd496dbd9 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:21.925114 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-3d2d3ccf-25f8-4bd3-b7ac-90e02e29c390 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:21.937327 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-3d2d3ccf-25f8-4bd3-b7ac-90e02e29c390 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61" status: 200 len: 1322 microversion: 2.1 time: 0.201474 Jun 30 12:33:21.939182 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 28/57] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:21 2022] GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61 => generated 1322 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:33:22.130438 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-8060edb8-7ec9-406a-b2f3-842bd496dbd9 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b688425466947198520ec7554bb49f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe4f134e4084a878a5e5cf59d96630f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:22.139866 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-8060edb8-7ec9-406a-b2f3-842bd496dbd9 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] 10.222.0.57 "GET /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26" status: 200 len: 1315 microversion: 2.1 time: 0.252293 Jun 30 12:33:22.140582 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 30/58] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:21 2022] GET /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26 => generated 1315 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 12:33:22.336598 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-afea7c2e-4b8c-48b8-8b19-dba29af82f79 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:22.341925 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-afea7c2e-4b8c-48b8-8b19-dba29af82f79 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 99ba3b96-6700-41e0-b2cf-ff8933b2bf94] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:22.351282 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-afea7c2e-4b8c-48b8-8b19-dba29af82f79 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:22.352052 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-afea7c2e-4b8c-48b8-8b19-dba29af82f79 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:22.353103 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-afea7c2e-4b8c-48b8-8b19-dba29af82f79 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:22.353852 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-afea7c2e-4b8c-48b8-8b19-dba29af82f79 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:22.481979 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-afea7c2e-4b8c-48b8-8b19-dba29af82f79 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddb38b4d6864a6c96b84c9a4092eea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60d10dba1d947cc97149a063a810129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:22.499065 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-afea7c2e-4b8c-48b8-8b19-dba29af82f79 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94" status: 200 len: 1294 microversion: 2.1 time: 0.165977 Jun 30 12:33:22.501654 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 29/59] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:22 2022] GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94 => generated 1294 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:33:22.954931 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-bd487f2b-26aa-4506-8e85-0dc69fb2f8e9 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:22.955539 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-bd487f2b-26aa-4506-8e85-0dc69fb2f8e9 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: a2fe3bb8-40b2-4dea-818a-083e0bc5fb61] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:22.961682 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-bd487f2b-26aa-4506-8e85-0dc69fb2f8e9 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:22.962179 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-bd487f2b-26aa-4506-8e85-0dc69fb2f8e9 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:22.963003 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-bd487f2b-26aa-4506-8e85-0dc69fb2f8e9 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:22.963433 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-bd487f2b-26aa-4506-8e85-0dc69fb2f8e9 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:22.967453 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG dbcounter [-] [124297] Writing DB stats nova_cell1:SELECT=100 {{(pid=124297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:33:23.107533 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-bd487f2b-26aa-4506-8e85-0dc69fb2f8e9 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:23.117805 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-bd487f2b-26aa-4506-8e85-0dc69fb2f8e9 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61" status: 200 len: 1322 microversion: 2.1 time: 0.166333 Jun 30 12:33:23.118866 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 31/60] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:22 2022] GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61 => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:33:23.156744 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-f9b11e8c-1598-494e-a941-70b8c252e0cd tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:23.157563 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-f9b11e8c-1598-494e-a941-70b8c252e0cd tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] [instance: 13f18862-cd59-44c8-a5c7-08d003e51e26] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:23.163754 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-f9b11e8c-1598-494e-a941-70b8c252e0cd tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:23.164266 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-f9b11e8c-1598-494e-a941-70b8c252e0cd tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:23.165135 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-f9b11e8c-1598-494e-a941-70b8c252e0cd tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:23.165634 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-f9b11e8c-1598-494e-a941-70b8c252e0cd tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:23.186381 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG dbcounter [-] [124298] Writing DB stats nova_cell1:SELECT=100 {{(pid=124298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:33:23.321663 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-f9b11e8c-1598-494e-a941-70b8c252e0cd tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b688425466947198520ec7554bb49f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe4f134e4084a878a5e5cf59d96630f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:23.330385 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-f9b11e8c-1598-494e-a941-70b8c252e0cd tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] 10.222.0.57 "GET /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26" status: 200 len: 1315 microversion: 2.1 time: 0.177688 Jun 30 12:33:23.331198 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 30/61] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:23 2022] GET /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26 => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:33:23.517569 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-fc69dee3-fd27-4b2b-811a-f15d78224086 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:23.518738 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-fc69dee3-fd27-4b2b-811a-f15d78224086 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 99ba3b96-6700-41e0-b2cf-ff8933b2bf94] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:23.525583 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-fc69dee3-fd27-4b2b-811a-f15d78224086 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:23.526265 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-fc69dee3-fd27-4b2b-811a-f15d78224086 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:23.527225 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-fc69dee3-fd27-4b2b-811a-f15d78224086 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:23.527657 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-fc69dee3-fd27-4b2b-811a-f15d78224086 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:23.613515 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-fc69dee3-fd27-4b2b-811a-f15d78224086 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddb38b4d6864a6c96b84c9a4092eea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60d10dba1d947cc97149a063a810129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:23.622385 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-fc69dee3-fd27-4b2b-811a-f15d78224086 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94" status: 200 len: 1294 microversion: 2.1 time: 0.108900 Jun 30 12:33:23.622971 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 32/62] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:23 2022] GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94 => generated 1294 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:33:24.137053 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-259c9104-6407-4fe5-8d69-c65e721a60d8 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:24.138352 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-259c9104-6407-4fe5-8d69-c65e721a60d8 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: a2fe3bb8-40b2-4dea-818a-083e0bc5fb61] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:24.146059 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-259c9104-6407-4fe5-8d69-c65e721a60d8 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:24.146562 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-259c9104-6407-4fe5-8d69-c65e721a60d8 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:24.147382 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-259c9104-6407-4fe5-8d69-c65e721a60d8 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:24.147985 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-259c9104-6407-4fe5-8d69-c65e721a60d8 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:24.352989 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-5cbd3c4a-7d92-440d-893e-8f675f41bb6c tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:24.355938 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-5cbd3c4a-7d92-440d-893e-8f675f41bb6c tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] [instance: 13f18862-cd59-44c8-a5c7-08d003e51e26] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:24.365304 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-5cbd3c4a-7d92-440d-893e-8f675f41bb6c tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:24.368676 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-5cbd3c4a-7d92-440d-893e-8f675f41bb6c tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:24.371837 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-5cbd3c4a-7d92-440d-893e-8f675f41bb6c tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:24.371837 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-5cbd3c4a-7d92-440d-893e-8f675f41bb6c tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:24.439239 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-259c9104-6407-4fe5-8d69-c65e721a60d8 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:24.446811 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-259c9104-6407-4fe5-8d69-c65e721a60d8 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61" status: 200 len: 1322 microversion: 2.1 time: 0.314837 Jun 30 12:33:24.447434 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 31/63] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:24 2022] GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61 => generated 1322 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:33:24.642521 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-04f12866-492c-4db4-990e-6fa56d810127 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:24.643246 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-04f12866-492c-4db4-990e-6fa56d810127 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 99ba3b96-6700-41e0-b2cf-ff8933b2bf94] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:24.651723 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-04f12866-492c-4db4-990e-6fa56d810127 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:24.652173 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-04f12866-492c-4db4-990e-6fa56d810127 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:24.657110 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-04f12866-492c-4db4-990e-6fa56d810127 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:24.657586 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-04f12866-492c-4db4-990e-6fa56d810127 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:24.665878 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-5cbd3c4a-7d92-440d-893e-8f675f41bb6c tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b688425466947198520ec7554bb49f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe4f134e4084a878a5e5cf59d96630f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:24.674170 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-5cbd3c4a-7d92-440d-893e-8f675f41bb6c tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] 10.222.0.57 "GET /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26" status: 200 len: 1315 microversion: 2.1 time: 0.330017 Jun 30 12:33:24.675736 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 33/64] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:24 2022] GET /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26 => generated 1315 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:33:24.771030 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-04f12866-492c-4db4-990e-6fa56d810127 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddb38b4d6864a6c96b84c9a4092eea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60d10dba1d947cc97149a063a810129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:24.781670 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-04f12866-492c-4db4-990e-6fa56d810127 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94" status: 200 len: 1294 microversion: 2.1 time: 0.143732 Jun 30 12:33:24.782731 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 32/65] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:24 2022] GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94 => generated 1294 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:33:25.471267 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-a4cedaad-959c-4a11-ac39-2d47575fde5e tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:25.471875 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-a4cedaad-959c-4a11-ac39-2d47575fde5e tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: a2fe3bb8-40b2-4dea-818a-083e0bc5fb61] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:25.477875 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-a4cedaad-959c-4a11-ac39-2d47575fde5e tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:25.478318 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-a4cedaad-959c-4a11-ac39-2d47575fde5e tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:25.479070 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-a4cedaad-959c-4a11-ac39-2d47575fde5e tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:25.479497 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-a4cedaad-959c-4a11-ac39-2d47575fde5e tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:25.617660 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-a4cedaad-959c-4a11-ac39-2d47575fde5e tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:25.625726 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-a4cedaad-959c-4a11-ac39-2d47575fde5e tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61" status: 200 len: 1322 microversion: 2.1 time: 0.158263 Jun 30 12:33:25.626299 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 34/66] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:25 2022] GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 12:33:25.693047 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-f3c4b4ea-d6b3-4e09-bf37-b40b789de7b5 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:25.693792 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-f3c4b4ea-d6b3-4e09-bf37-b40b789de7b5 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] [instance: 13f18862-cd59-44c8-a5c7-08d003e51e26] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:25.699944 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-f3c4b4ea-d6b3-4e09-bf37-b40b789de7b5 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:25.700456 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-f3c4b4ea-d6b3-4e09-bf37-b40b789de7b5 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:25.701261 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-f3c4b4ea-d6b3-4e09-bf37-b40b789de7b5 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:25.701702 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-f3c4b4ea-d6b3-4e09-bf37-b40b789de7b5 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:25.799978 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-85471e9a-e22b-4328-9015-ea7d940efb0f tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:25.800966 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-85471e9a-e22b-4328-9015-ea7d940efb0f tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 99ba3b96-6700-41e0-b2cf-ff8933b2bf94] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:25.807517 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-85471e9a-e22b-4328-9015-ea7d940efb0f tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:25.808195 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-85471e9a-e22b-4328-9015-ea7d940efb0f tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:25.809571 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-85471e9a-e22b-4328-9015-ea7d940efb0f tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:25.810196 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-85471e9a-e22b-4328-9015-ea7d940efb0f tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:25.876258 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-f3c4b4ea-d6b3-4e09-bf37-b40b789de7b5 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b688425466947198520ec7554bb49f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe4f134e4084a878a5e5cf59d96630f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:25.883829 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-f3c4b4ea-d6b3-4e09-bf37-b40b789de7b5 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] 10.222.0.57 "GET /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26" status: 200 len: 1315 microversion: 2.1 time: 0.194763 Jun 30 12:33:25.884372 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 33/67] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:25 2022] GET /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26 => generated 1315 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 12:33:25.898151 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-85471e9a-e22b-4328-9015-ea7d940efb0f tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddb38b4d6864a6c96b84c9a4092eea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60d10dba1d947cc97149a063a810129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:25.908939 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-85471e9a-e22b-4328-9015-ea7d940efb0f tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94" status: 200 len: 1294 microversion: 2.1 time: 0.113225 Jun 30 12:33:25.909534 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 35/68] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:25 2022] GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94 => generated 1294 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:33:26.642082 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-07d7288c-0696-4917-bdff-9d23abe34430 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:26.642694 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-07d7288c-0696-4917-bdff-9d23abe34430 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: a2fe3bb8-40b2-4dea-818a-083e0bc5fb61] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:26.648766 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-07d7288c-0696-4917-bdff-9d23abe34430 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:26.649215 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-07d7288c-0696-4917-bdff-9d23abe34430 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:26.649999 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-07d7288c-0696-4917-bdff-9d23abe34430 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:26.650409 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-07d7288c-0696-4917-bdff-9d23abe34430 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:26.786369 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-07d7288c-0696-4917-bdff-9d23abe34430 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:26.794433 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-07d7288c-0696-4917-bdff-9d23abe34430 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61" status: 200 len: 1322 microversion: 2.1 time: 0.156525 Jun 30 12:33:26.805065 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 34/69] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:26 2022] GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:33:26.901166 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-bebbfdd2-ac38-431d-8eb8-95f5f09ef1bb tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:26.901873 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-bebbfdd2-ac38-431d-8eb8-95f5f09ef1bb tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] [instance: 13f18862-cd59-44c8-a5c7-08d003e51e26] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:26.908399 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-bebbfdd2-ac38-431d-8eb8-95f5f09ef1bb tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:26.908843 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-bebbfdd2-ac38-431d-8eb8-95f5f09ef1bb tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:26.909634 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-bebbfdd2-ac38-431d-8eb8-95f5f09ef1bb tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:26.910055 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-bebbfdd2-ac38-431d-8eb8-95f5f09ef1bb tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:26.926677 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-aaf183ff-30bf-440e-a175-78f2c8f4ff91 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:26.927487 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-aaf183ff-30bf-440e-a175-78f2c8f4ff91 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 99ba3b96-6700-41e0-b2cf-ff8933b2bf94] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:26.934080 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-aaf183ff-30bf-440e-a175-78f2c8f4ff91 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:26.934532 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-aaf183ff-30bf-440e-a175-78f2c8f4ff91 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:26.935398 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-aaf183ff-30bf-440e-a175-78f2c8f4ff91 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:26.935939 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-aaf183ff-30bf-440e-a175-78f2c8f4ff91 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:27.012571 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-aaf183ff-30bf-440e-a175-78f2c8f4ff91 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddb38b4d6864a6c96b84c9a4092eea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60d10dba1d947cc97149a063a810129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:27.026851 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-aaf183ff-30bf-440e-a175-78f2c8f4ff91 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94" status: 200 len: 1294 microversion: 2.1 time: 0.104331 Jun 30 12:33:27.027836 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 35/70] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:26 2022] GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94 => generated 1294 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 12:33:27.070262 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-bebbfdd2-ac38-431d-8eb8-95f5f09ef1bb tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b688425466947198520ec7554bb49f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe4f134e4084a878a5e5cf59d96630f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:27.077788 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-bebbfdd2-ac38-431d-8eb8-95f5f09ef1bb tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] 10.222.0.57 "GET /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26" status: 200 len: 1315 microversion: 2.1 time: 0.180699 Jun 30 12:33:27.078382 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 36/71] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:26 2022] GET /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26 => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:33:27.823058 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-21e99f9f-23ae-4239-95ca-8c8fef45c257 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:27.823989 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-21e99f9f-23ae-4239-95ca-8c8fef45c257 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: a2fe3bb8-40b2-4dea-818a-083e0bc5fb61] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:27.834939 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG dbcounter [-] [124298] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=9 {{(pid=124298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:33:27.837102 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-21e99f9f-23ae-4239-95ca-8c8fef45c257 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:27.839455 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-21e99f9f-23ae-4239-95ca-8c8fef45c257 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:27.841529 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-21e99f9f-23ae-4239-95ca-8c8fef45c257 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:27.842323 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-21e99f9f-23ae-4239-95ca-8c8fef45c257 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:28.044335 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-08e36de5-0dd1-4159-8f2e-f56f213d5ba7 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:28.045754 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-08e36de5-0dd1-4159-8f2e-f56f213d5ba7 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 99ba3b96-6700-41e0-b2cf-ff8933b2bf94] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:28.059862 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-08e36de5-0dd1-4159-8f2e-f56f213d5ba7 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:28.060323 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-08e36de5-0dd1-4159-8f2e-f56f213d5ba7 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:28.061676 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-08e36de5-0dd1-4159-8f2e-f56f213d5ba7 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:28.062113 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-08e36de5-0dd1-4159-8f2e-f56f213d5ba7 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:28.180301 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-08e36de5-0dd1-4159-8f2e-f56f213d5ba7 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddb38b4d6864a6c96b84c9a4092eea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60d10dba1d947cc97149a063a810129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:28.211217 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-08e36de5-0dd1-4159-8f2e-f56f213d5ba7 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94" status: 200 len: 1294 microversion: 2.1 time: 0.170115 Jun 30 12:33:28.212148 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 37/72] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:28 2022] GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94 => generated 1294 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:33:28.226846 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-21e99f9f-23ae-4239-95ca-8c8fef45c257 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:28.232235 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-12697d32-3597-43b9-9a13-44a42f0a3c99 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:28.233037 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-12697d32-3597-43b9-9a13-44a42f0a3c99 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] [instance: 13f18862-cd59-44c8-a5c7-08d003e51e26] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:28.237209 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-21e99f9f-23ae-4239-95ca-8c8fef45c257 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61" status: 200 len: 1322 microversion: 2.1 time: 0.424268 Jun 30 12:33:28.238643 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 36/73] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:27 2022] GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61 => generated 1322 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:33:28.255439 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-12697d32-3597-43b9-9a13-44a42f0a3c99 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:28.255802 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-12697d32-3597-43b9-9a13-44a42f0a3c99 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:28.259656 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-12697d32-3597-43b9-9a13-44a42f0a3c99 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:28.260191 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-12697d32-3597-43b9-9a13-44a42f0a3c99 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:28.763691 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-12697d32-3597-43b9-9a13-44a42f0a3c99 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b688425466947198520ec7554bb49f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe4f134e4084a878a5e5cf59d96630f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:28.789759 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-12697d32-3597-43b9-9a13-44a42f0a3c99 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] 10.222.0.57 "GET /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26" status: 200 len: 1315 microversion: 2.1 time: 0.576440 Jun 30 12:33:28.800433 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 38/74] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:28 2022] GET /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26 => generated 1315 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:33:29.230277 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-cde0bcab-72d9-4d14-98d9-b53117c4f5b0 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:29.230898 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-cde0bcab-72d9-4d14-98d9-b53117c4f5b0 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 99ba3b96-6700-41e0-b2cf-ff8933b2bf94] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:29.244280 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-cde0bcab-72d9-4d14-98d9-b53117c4f5b0 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:29.244828 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-cde0bcab-72d9-4d14-98d9-b53117c4f5b0 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:29.245749 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-cde0bcab-72d9-4d14-98d9-b53117c4f5b0 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:29.246189 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-cde0bcab-72d9-4d14-98d9-b53117c4f5b0 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:29.259535 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-7cccfbc3-090e-448f-b711-83907d07d254 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:29.261129 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-7cccfbc3-090e-448f-b711-83907d07d254 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: a2fe3bb8-40b2-4dea-818a-083e0bc5fb61] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:29.281251 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-7cccfbc3-090e-448f-b711-83907d07d254 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:29.282361 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-7cccfbc3-090e-448f-b711-83907d07d254 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:29.284193 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-7cccfbc3-090e-448f-b711-83907d07d254 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:29.285142 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-7cccfbc3-090e-448f-b711-83907d07d254 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:30.033524 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-7cccfbc3-090e-448f-b711-83907d07d254 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:30.060185 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-7cccfbc3-090e-448f-b711-83907d07d254 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61" status: 200 len: 1322 microversion: 2.1 time: 0.809458 Jun 30 12:33:30.060821 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 39/75] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:29 2022] GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61 => generated 1322 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 12:33:30.087322 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-cf92f86b-d335-4a93-b526-c1eee614cade tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:30.088043 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-cf92f86b-d335-4a93-b526-c1eee614cade tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] [instance: 13f18862-cd59-44c8-a5c7-08d003e51e26] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:30.100360 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-cf92f86b-d335-4a93-b526-c1eee614cade tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:30.101329 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-cf92f86b-d335-4a93-b526-c1eee614cade tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:30.102319 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-cf92f86b-d335-4a93-b526-c1eee614cade tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:30.102758 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-cf92f86b-d335-4a93-b526-c1eee614cade tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:30.198853 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-cde0bcab-72d9-4d14-98d9-b53117c4f5b0 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddb38b4d6864a6c96b84c9a4092eea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60d10dba1d947cc97149a063a810129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:30.208305 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-cde0bcab-72d9-4d14-98d9-b53117c4f5b0 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94" status: 200 len: 1361 microversion: 2.1 time: 0.982867 Jun 30 12:33:30.208929 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 37/76] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:29 2022] GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94 => generated 1361 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:33:30.369255 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-cf92f86b-d335-4a93-b526-c1eee614cade tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b688425466947198520ec7554bb49f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe4f134e4084a878a5e5cf59d96630f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:30.380840 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-cf92f86b-d335-4a93-b526-c1eee614cade tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] 10.222.0.57 "GET /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26" status: 200 len: 1315 microversion: 2.1 time: 0.318884 Jun 30 12:33:30.381392 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 40/77] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:30 2022] GET /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26 => generated 1315 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:33:30.434892 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [req-b28eb094-128a-410e-b351-0e449f3f4336 req-9a96a1c5-7ece-42bb-ae53-a1003b5f4047 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2fe3bb8-40b2-4dea-818a-083e0bc5fb61", "tag": "7141f81e-2130-4ea4-bd66-d50c16384aaf"}]} {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:33:30.446684 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [req-b28eb094-128a-410e-b351-0e449f3f4336 req-9a96a1c5-7ece-42bb-ae53-a1003b5f4047 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:30.447132 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [req-b28eb094-128a-410e-b351-0e449f3f4336 req-9a96a1c5-7ece-42bb-ae53-a1003b5f4047 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:30.466801 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.compute.server_external_events [req-b28eb094-128a-410e-b351-0e449f3f4336 req-9a96a1c5-7ece-42bb-ae53-a1003b5f4047 service nova] Creating event network-changed:7141f81e-2130-4ea4-bd66-d50c16384aaf for instance a2fe3bb8-40b2-4dea-818a-083e0bc5fb61 on hv-cinder-84614 Jun 30 12:33:30.467522 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [req-b28eb094-128a-410e-b351-0e449f3f4336 req-9a96a1c5-7ece-42bb-ae53-a1003b5f4047 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124298) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 30 12:33:30.468659 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-c92f991f-ec2d-4381-86f7-47af8c7999df None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:30.469098 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-c92f991f-ec2d-4381-86f7-47af8c7999df None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:30.470207 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-c92f991f-ec2d-4381-86f7-47af8c7999df None None] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:30.470845 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-c92f991f-ec2d-4381-86f7-47af8c7999df None None] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:30.483048 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.compute.rpcapi [None req-c92f991f-ec2d-4381-86f7-47af8c7999df None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 30 12:33:30.483960 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-c92f991f-ec2d-4381-86f7-47af8c7999df None None] Releasing lock "compute-rpcapi-router" {{(pid=124298) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 30 12:33:30.500199 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-c92f991f-ec2d-4381-86f7-47af8c7999df None None] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.265411 Jun 30 12:33:30.501013 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 38/78] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 30 12:33:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:33:30.579836 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [req-25dd2ab2-9d9e-45d3-9f2c-6abbdcc3022e req-1ea23e30-5ed5-45d3-bbab-12201d6df9cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13f18862-cd59-44c8-a5c7-08d003e51e26", "tag": "a1bc8255-e853-401f-8e86-93ea2467a967"}]} {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:33:30.591732 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [req-25dd2ab2-9d9e-45d3-9f2c-6abbdcc3022e req-1ea23e30-5ed5-45d3-bbab-12201d6df9cc service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:30.592422 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [req-25dd2ab2-9d9e-45d3-9f2c-6abbdcc3022e req-1ea23e30-5ed5-45d3-bbab-12201d6df9cc service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:30.611849 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.compute.server_external_events [req-25dd2ab2-9d9e-45d3-9f2c-6abbdcc3022e req-1ea23e30-5ed5-45d3-bbab-12201d6df9cc service nova] Creating event network-changed:a1bc8255-e853-401f-8e86-93ea2467a967 for instance 13f18862-cd59-44c8-a5c7-08d003e51e26 on hv-cinder-84614 Jun 30 12:33:30.612377 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [req-25dd2ab2-9d9e-45d3-9f2c-6abbdcc3022e req-1ea23e30-5ed5-45d3-bbab-12201d6df9cc service nova] Acquired lock "compute-rpcapi-router" {{(pid=124297) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 30 12:33:30.613513 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-5dfb437c-588c-4ba3-9125-3f60fa240bdf None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:30.613943 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-5dfb437c-588c-4ba3-9125-3f60fa240bdf None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:30.614750 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-5dfb437c-588c-4ba3-9125-3f60fa240bdf None None] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:30.615175 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-5dfb437c-588c-4ba3-9125-3f60fa240bdf None None] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:30.624359 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.compute.rpcapi [None req-5dfb437c-588c-4ba3-9125-3f60fa240bdf None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 30 12:33:30.625256 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-5dfb437c-588c-4ba3-9125-3f60fa240bdf None None] Releasing lock "compute-rpcapi-router" {{(pid=124297) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 30 12:33:30.646198 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-5dfb437c-588c-4ba3-9125-3f60fa240bdf None None] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.199986 Jun 30 12:33:30.646993 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 41/79] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 30 12:33:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 12:33:31.080018 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-6b28a382-10b1-4b2d-8efe-e40441de98fa tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:31.081296 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-6b28a382-10b1-4b2d-8efe-e40441de98fa tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: a2fe3bb8-40b2-4dea-818a-083e0bc5fb61] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:31.088059 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-6b28a382-10b1-4b2d-8efe-e40441de98fa tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:31.088510 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-6b28a382-10b1-4b2d-8efe-e40441de98fa tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:31.089422 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-6b28a382-10b1-4b2d-8efe-e40441de98fa tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:31.090023 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-6b28a382-10b1-4b2d-8efe-e40441de98fa tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:31.232659 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-207988a9-14ad-42bf-8f19-b0aa76de1670 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:31.234014 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-207988a9-14ad-42bf-8f19-b0aa76de1670 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 99ba3b96-6700-41e0-b2cf-ff8933b2bf94] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:31.267944 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-207988a9-14ad-42bf-8f19-b0aa76de1670 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:31.268396 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-207988a9-14ad-42bf-8f19-b0aa76de1670 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:31.271574 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-207988a9-14ad-42bf-8f19-b0aa76de1670 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:31.272261 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-207988a9-14ad-42bf-8f19-b0aa76de1670 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:31.296400 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-6b28a382-10b1-4b2d-8efe-e40441de98fa tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:31.305439 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-6b28a382-10b1-4b2d-8efe-e40441de98fa tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61" status: 200 len: 1322 microversion: 2.1 time: 0.231113 Jun 30 12:33:31.306689 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 39/80] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:31 2022] GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61 => generated 1322 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:33:31.399349 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-e0270fe8-b8bc-4e4a-9bff-76ff141a083d tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:31.399973 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-e0270fe8-b8bc-4e4a-9bff-76ff141a083d tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] [instance: 13f18862-cd59-44c8-a5c7-08d003e51e26] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:31.407104 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-e0270fe8-b8bc-4e4a-9bff-76ff141a083d tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:31.408276 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-e0270fe8-b8bc-4e4a-9bff-76ff141a083d tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:31.409151 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-e0270fe8-b8bc-4e4a-9bff-76ff141a083d tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:31.409597 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-e0270fe8-b8bc-4e4a-9bff-76ff141a083d tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:31.693340 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-207988a9-14ad-42bf-8f19-b0aa76de1670 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddb38b4d6864a6c96b84c9a4092eea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60d10dba1d947cc97149a063a810129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:31.702368 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-207988a9-14ad-42bf-8f19-b0aa76de1670 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94" status: 200 len: 1361 microversion: 2.1 time: 0.479457 Jun 30 12:33:31.711863 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 42/81] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:31 2022] GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94 => generated 1361 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:33:31.761891 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-e0270fe8-b8bc-4e4a-9bff-76ff141a083d tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b688425466947198520ec7554bb49f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe4f134e4084a878a5e5cf59d96630f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:31.770454 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-e0270fe8-b8bc-4e4a-9bff-76ff141a083d tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] 10.222.0.57 "GET /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26" status: 200 len: 1315 microversion: 2.1 time: 0.375137 Jun 30 12:33:31.771525 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 40/82] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:31 2022] GET /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26 => generated 1315 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 12:33:32.333868 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-21ce965e-48a4-4f08-98e3-45864183386d tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:32.334466 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-21ce965e-48a4-4f08-98e3-45864183386d tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: a2fe3bb8-40b2-4dea-818a-083e0bc5fb61] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:32.340784 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-21ce965e-48a4-4f08-98e3-45864183386d tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:32.341488 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-21ce965e-48a4-4f08-98e3-45864183386d tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:32.342509 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-21ce965e-48a4-4f08-98e3-45864183386d tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:32.342999 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-21ce965e-48a4-4f08-98e3-45864183386d tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:32.527034 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-21ce965e-48a4-4f08-98e3-45864183386d tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:32.535901 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-21ce965e-48a4-4f08-98e3-45864183386d tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61" status: 200 len: 1322 microversion: 2.1 time: 0.205946 Jun 30 12:33:32.546306 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 43/83] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:32 2022] GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61 => generated 1322 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 12:33:32.720314 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-e119eefd-94c5-4775-a97f-d438bc8115f8 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:32.720950 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-e119eefd-94c5-4775-a97f-d438bc8115f8 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 99ba3b96-6700-41e0-b2cf-ff8933b2bf94] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:32.738382 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-e119eefd-94c5-4775-a97f-d438bc8115f8 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:32.739060 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-e119eefd-94c5-4775-a97f-d438bc8115f8 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:32.739833 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-e119eefd-94c5-4775-a97f-d438bc8115f8 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:32.740262 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-e119eefd-94c5-4775-a97f-d438bc8115f8 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:32.788510 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-ebf369e6-40d9-416e-bba3-6e2370c37fdb tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:32.789289 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-ebf369e6-40d9-416e-bba3-6e2370c37fdb tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] [instance: 13f18862-cd59-44c8-a5c7-08d003e51e26] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:32.796476 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-ebf369e6-40d9-416e-bba3-6e2370c37fdb tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:32.798136 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-ebf369e6-40d9-416e-bba3-6e2370c37fdb tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:32.799292 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-ebf369e6-40d9-416e-bba3-6e2370c37fdb tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:32.799970 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-ebf369e6-40d9-416e-bba3-6e2370c37fdb tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:32.983944 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-e119eefd-94c5-4775-a97f-d438bc8115f8 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddb38b4d6864a6c96b84c9a4092eea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60d10dba1d947cc97149a063a810129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:32.993355 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-e119eefd-94c5-4775-a97f-d438bc8115f8 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94" status: 200 len: 1361 microversion: 2.1 time: 0.277095 Jun 30 12:33:32.994291 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 41/84] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:32 2022] GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94 => generated 1361 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:33:33.015237 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [req-c8d63edf-bacd-4a5a-8388-52f5cb5d9fe1 req-2395a2ef-adae-4433-ac25-96db33bf16ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99a31213-cbcb-4b2c-b07f-ab67e78a2096", "tag": "cedc0eef-3278-4f0e-aa08-b47c9f4b77c6"}]} {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:33:33.025691 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [req-c8d63edf-bacd-4a5a-8388-52f5cb5d9fe1 req-2395a2ef-adae-4433-ac25-96db33bf16ee service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:33.026137 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [req-c8d63edf-bacd-4a5a-8388-52f5cb5d9fe1 req-2395a2ef-adae-4433-ac25-96db33bf16ee service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:33.032104 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-ebf369e6-40d9-416e-bba3-6e2370c37fdb tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b688425466947198520ec7554bb49f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe4f134e4084a878a5e5cf59d96630f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:33.042972 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-ebf369e6-40d9-416e-bba3-6e2370c37fdb tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] 10.222.0.57 "GET /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26" status: 200 len: 1315 microversion: 2.1 time: 0.259470 Jun 30 12:33:33.043890 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 44/85] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:32 2022] GET /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26 => generated 1315 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:33:33.059211 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.compute.server_external_events [req-c8d63edf-bacd-4a5a-8388-52f5cb5d9fe1 req-2395a2ef-adae-4433-ac25-96db33bf16ee service nova] Creating event network-changed:cedc0eef-3278-4f0e-aa08-b47c9f4b77c6 for instance 99a31213-cbcb-4b2c-b07f-ab67e78a2096 on hv-cinder-84614 Jun 30 12:33:33.065936 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [req-c8d63edf-bacd-4a5a-8388-52f5cb5d9fe1 req-2395a2ef-adae-4433-ac25-96db33bf16ee service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070453 Jun 30 12:33:33.066538 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 42/86] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 30 12:33:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:33:33.557993 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-810cd789-be29-4152-b5e6-94dbd5191a8e tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:33.559007 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-810cd789-be29-4152-b5e6-94dbd5191a8e tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: a2fe3bb8-40b2-4dea-818a-083e0bc5fb61] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:33.569636 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-810cd789-be29-4152-b5e6-94dbd5191a8e tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:33.570380 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-810cd789-be29-4152-b5e6-94dbd5191a8e tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:33.571645 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-810cd789-be29-4152-b5e6-94dbd5191a8e tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:33.572503 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-810cd789-be29-4152-b5e6-94dbd5191a8e tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:33.716991 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-810cd789-be29-4152-b5e6-94dbd5191a8e tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:33.724760 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-810cd789-be29-4152-b5e6-94dbd5191a8e tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61" status: 200 len: 1322 microversion: 2.1 time: 0.173192 Jun 30 12:33:33.725330 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 45/87] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:33 2022] GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61 => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:33:34.016285 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-b9fa7473-dacd-4f63-a06e-c12c2255874a tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:34.017535 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-b9fa7473-dacd-4f63-a06e-c12c2255874a tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 99ba3b96-6700-41e0-b2cf-ff8933b2bf94] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:34.028438 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-b9fa7473-dacd-4f63-a06e-c12c2255874a tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:34.029156 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-b9fa7473-dacd-4f63-a06e-c12c2255874a tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:34.030019 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-b9fa7473-dacd-4f63-a06e-c12c2255874a tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:34.030562 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-b9fa7473-dacd-4f63-a06e-c12c2255874a tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:34.062440 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-8f926c74-f91d-47a2-b4e7-5247307dcf54 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:34.063125 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-8f926c74-f91d-47a2-b4e7-5247307dcf54 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] [instance: 13f18862-cd59-44c8-a5c7-08d003e51e26] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:34.069877 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-8f926c74-f91d-47a2-b4e7-5247307dcf54 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:34.070417 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-8f926c74-f91d-47a2-b4e7-5247307dcf54 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:34.071260 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-8f926c74-f91d-47a2-b4e7-5247307dcf54 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:34.071763 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-8f926c74-f91d-47a2-b4e7-5247307dcf54 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:34.227964 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-b9fa7473-dacd-4f63-a06e-c12c2255874a tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddb38b4d6864a6c96b84c9a4092eea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60d10dba1d947cc97149a063a810129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:34.235581 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-b9fa7473-dacd-4f63-a06e-c12c2255874a tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94" status: 200 len: 1361 microversion: 2.1 time: 0.226614 Jun 30 12:33:34.236161 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 43/88] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:34 2022] GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94 => generated 1361 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:33:34.255028 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-8f926c74-f91d-47a2-b4e7-5247307dcf54 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b688425466947198520ec7554bb49f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe4f134e4084a878a5e5cf59d96630f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:34.265226 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-8f926c74-f91d-47a2-b4e7-5247307dcf54 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] 10.222.0.57 "GET /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26" status: 200 len: 1315 microversion: 2.1 time: 0.206855 Jun 30 12:33:34.265792 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 46/89] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:34 2022] GET /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26 => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:33:34.742926 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-85ad28c1-635c-4bb4-a886-50161e90332a tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:34.743870 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-85ad28c1-635c-4bb4-a886-50161e90332a tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: a2fe3bb8-40b2-4dea-818a-083e0bc5fb61] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:34.751301 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-85ad28c1-635c-4bb4-a886-50161e90332a tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:34.752099 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-85ad28c1-635c-4bb4-a886-50161e90332a tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:34.753307 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-85ad28c1-635c-4bb4-a886-50161e90332a tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:34.754155 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-85ad28c1-635c-4bb4-a886-50161e90332a tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:35.109298 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [req-7a0ddf3e-df44-499a-b235-aca972d4709d req-2437e3e3-5bef-4127-9db2-af566424b227 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99ba3b96-6700-41e0-b2cf-ff8933b2bf94", "tag": "3cb03b0c-2687-4749-9a21-f441e6a23823"}]} {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:33:35.118193 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [req-7a0ddf3e-df44-499a-b235-aca972d4709d req-2437e3e3-5bef-4127-9db2-af566424b227 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:35.118646 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [req-7a0ddf3e-df44-499a-b235-aca972d4709d req-2437e3e3-5bef-4127-9db2-af566424b227 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:35.131736 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.compute.server_external_events [req-7a0ddf3e-df44-499a-b235-aca972d4709d req-2437e3e3-5bef-4127-9db2-af566424b227 service nova] Creating event network-changed:3cb03b0c-2687-4749-9a21-f441e6a23823 for instance 99ba3b96-6700-41e0-b2cf-ff8933b2bf94 on hv-cinder-84614 Jun 30 12:33:35.151789 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [req-7a0ddf3e-df44-499a-b235-aca972d4709d req-2437e3e3-5bef-4127-9db2-af566424b227 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045773 Jun 30 12:33:35.152419 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 47/90] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 30 12:33:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 12:33:35.175600 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-85ad28c1-635c-4bb4-a886-50161e90332a tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:35.189411 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-85ad28c1-635c-4bb4-a886-50161e90332a tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61" status: 200 len: 1322 microversion: 2.1 time: 0.450449 Jun 30 12:33:35.199911 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 44/91] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:34 2022] GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61 => generated 1322 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:33:35.255458 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-8baba6ac-48f5-4696-b2cc-a63044c3459c tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:35.255458 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-8baba6ac-48f5-4696-b2cc-a63044c3459c tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 99ba3b96-6700-41e0-b2cf-ff8933b2bf94] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:35.260921 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-8baba6ac-48f5-4696-b2cc-a63044c3459c tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:35.261372 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-8baba6ac-48f5-4696-b2cc-a63044c3459c tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:35.262139 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-8baba6ac-48f5-4696-b2cc-a63044c3459c tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:35.262614 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-8baba6ac-48f5-4696-b2cc-a63044c3459c tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:35.288814 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-e1e1e688-9b42-4de0-8dfb-959a8e4779a0 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:35.289638 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-e1e1e688-9b42-4de0-8dfb-959a8e4779a0 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] [instance: 13f18862-cd59-44c8-a5c7-08d003e51e26] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:35.305506 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-e1e1e688-9b42-4de0-8dfb-959a8e4779a0 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:35.306028 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-e1e1e688-9b42-4de0-8dfb-959a8e4779a0 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:35.307382 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-e1e1e688-9b42-4de0-8dfb-959a8e4779a0 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:35.307929 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-e1e1e688-9b42-4de0-8dfb-959a8e4779a0 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:35.483837 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-8baba6ac-48f5-4696-b2cc-a63044c3459c tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddb38b4d6864a6c96b84c9a4092eea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60d10dba1d947cc97149a063a810129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:35.488174 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG dbcounter [-] [124297] Writing DB stats nova_cell1:SELECT=100 {{(pid=124297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:33:35.495609 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-8baba6ac-48f5-4696-b2cc-a63044c3459c tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94" status: 200 len: 1361 microversion: 2.1 time: 0.245940 Jun 30 12:33:35.501869 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 48/92] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:35 2022] GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94 => generated 1361 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:33:35.543191 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-e1e1e688-9b42-4de0-8dfb-959a8e4779a0 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b688425466947198520ec7554bb49f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe4f134e4084a878a5e5cf59d96630f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:35.552480 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-e1e1e688-9b42-4de0-8dfb-959a8e4779a0 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] 10.222.0.57 "GET /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26" status: 200 len: 1315 microversion: 2.1 time: 0.269823 Jun 30 12:33:35.562335 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 45/93] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:35 2022] GET /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26 => generated 1315 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:33:36.207160 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-08b08a5d-4373-44ad-954b-c0a8df54cc10 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:36.207772 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-08b08a5d-4373-44ad-954b-c0a8df54cc10 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: a2fe3bb8-40b2-4dea-818a-083e0bc5fb61] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:36.215112 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-08b08a5d-4373-44ad-954b-c0a8df54cc10 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:36.215614 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-08b08a5d-4373-44ad-954b-c0a8df54cc10 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:36.216441 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-08b08a5d-4373-44ad-954b-c0a8df54cc10 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:36.216919 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-08b08a5d-4373-44ad-954b-c0a8df54cc10 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:36.405301 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-08b08a5d-4373-44ad-954b-c0a8df54cc10 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:36.413990 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-08b08a5d-4373-44ad-954b-c0a8df54cc10 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61" status: 200 len: 1322 microversion: 2.1 time: 0.210766 Jun 30 12:33:36.424115 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 49/94] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:36 2022] GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61 => generated 1322 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:33:36.514738 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-72bc43fc-0bc4-4574-a93a-373e5af33a38 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:36.515368 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-72bc43fc-0bc4-4574-a93a-373e5af33a38 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 99ba3b96-6700-41e0-b2cf-ff8933b2bf94] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:36.522200 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-72bc43fc-0bc4-4574-a93a-373e5af33a38 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:36.522643 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-72bc43fc-0bc4-4574-a93a-373e5af33a38 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:36.523554 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-72bc43fc-0bc4-4574-a93a-373e5af33a38 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:36.523969 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-72bc43fc-0bc4-4574-a93a-373e5af33a38 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:36.569760 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-990a2c79-d99a-40cf-a9e2-818d320c7639 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:36.570894 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-990a2c79-d99a-40cf-a9e2-818d320c7639 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] [instance: 13f18862-cd59-44c8-a5c7-08d003e51e26] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:36.580991 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-990a2c79-d99a-40cf-a9e2-818d320c7639 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:36.581553 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-990a2c79-d99a-40cf-a9e2-818d320c7639 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:36.587117 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-990a2c79-d99a-40cf-a9e2-818d320c7639 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:36.587700 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-990a2c79-d99a-40cf-a9e2-818d320c7639 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:36.763485 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-72bc43fc-0bc4-4574-a93a-373e5af33a38 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddb38b4d6864a6c96b84c9a4092eea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60d10dba1d947cc97149a063a810129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:36.772451 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-72bc43fc-0bc4-4574-a93a-373e5af33a38 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94" status: 200 len: 1361 microversion: 2.1 time: 0.262811 Jun 30 12:33:36.773249 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 46/95] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:36 2022] GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94 => generated 1361 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:33:36.790798 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-990a2c79-d99a-40cf-a9e2-818d320c7639 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b688425466947198520ec7554bb49f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe4f134e4084a878a5e5cf59d96630f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:36.797321 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-990a2c79-d99a-40cf-a9e2-818d320c7639 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] 10.222.0.57 "GET /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26" status: 200 len: 1315 microversion: 2.1 time: 0.232124 Jun 30 12:33:36.798308 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 50/96] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:36 2022] GET /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26 => generated 1315 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 12:33:37.431330 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-9ac1e446-7040-409c-b31a-f703d2189576 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:37.431953 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-9ac1e446-7040-409c-b31a-f703d2189576 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: a2fe3bb8-40b2-4dea-818a-083e0bc5fb61] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:37.438859 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-9ac1e446-7040-409c-b31a-f703d2189576 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:37.439307 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-9ac1e446-7040-409c-b31a-f703d2189576 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:37.440088 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-9ac1e446-7040-409c-b31a-f703d2189576 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:37.440524 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-9ac1e446-7040-409c-b31a-f703d2189576 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:37.618733 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-9ac1e446-7040-409c-b31a-f703d2189576 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:37.629945 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-9ac1e446-7040-409c-b31a-f703d2189576 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61" status: 200 len: 1322 microversion: 2.1 time: 0.202331 Jun 30 12:33:37.630618 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 47/97] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:37 2022] GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61 => generated 1322 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:33:37.791146 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-9fac335f-a94e-43dc-b822-479070a8aa01 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:37.791847 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-9fac335f-a94e-43dc-b822-479070a8aa01 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 99ba3b96-6700-41e0-b2cf-ff8933b2bf94] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:37.800691 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-9fac335f-a94e-43dc-b822-479070a8aa01 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:37.801157 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-9fac335f-a94e-43dc-b822-479070a8aa01 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:37.801920 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-9fac335f-a94e-43dc-b822-479070a8aa01 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:37.802344 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-9fac335f-a94e-43dc-b822-479070a8aa01 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:37.815535 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-d09a0c91-87e4-42af-829d-51c0649ac378 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:37.816122 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-d09a0c91-87e4-42af-829d-51c0649ac378 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] [instance: 13f18862-cd59-44c8-a5c7-08d003e51e26] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:37.827132 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-d09a0c91-87e4-42af-829d-51c0649ac378 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:37.828793 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-d09a0c91-87e4-42af-829d-51c0649ac378 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:37.830100 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-d09a0c91-87e4-42af-829d-51c0649ac378 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:37.830779 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-d09a0c91-87e4-42af-829d-51c0649ac378 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:37.852806 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG dbcounter [-] [124298] Writing DB stats nova_cell1:SELECT=100 {{(pid=124298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:33:38.069817 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-9fac335f-a94e-43dc-b822-479070a8aa01 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddb38b4d6864a6c96b84c9a4092eea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60d10dba1d947cc97149a063a810129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:38.074933 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-d09a0c91-87e4-42af-829d-51c0649ac378 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b688425466947198520ec7554bb49f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe4f134e4084a878a5e5cf59d96630f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:38.079990 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-9fac335f-a94e-43dc-b822-479070a8aa01 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94" status: 200 len: 1361 microversion: 2.1 time: 0.293369 Jun 30 12:33:38.084816 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-d09a0c91-87e4-42af-829d-51c0649ac378 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] 10.222.0.57 "GET /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26" status: 200 len: 1315 microversion: 2.1 time: 0.273799 Jun 30 12:33:38.091208 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 51/98] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:37 2022] GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94 => generated 1361 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 12:33:38.092947 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 48/99] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:37 2022] GET /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26 => generated 1315 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 12:33:38.650694 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-e6d2deb7-87f3-4986-9149-47ad7335dc95 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:38.651571 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-e6d2deb7-87f3-4986-9149-47ad7335dc95 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: a2fe3bb8-40b2-4dea-818a-083e0bc5fb61] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:38.658579 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-e6d2deb7-87f3-4986-9149-47ad7335dc95 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:38.659250 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-e6d2deb7-87f3-4986-9149-47ad7335dc95 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:38.660191 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-e6d2deb7-87f3-4986-9149-47ad7335dc95 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:38.660767 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-e6d2deb7-87f3-4986-9149-47ad7335dc95 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:38.821770 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-e6d2deb7-87f3-4986-9149-47ad7335dc95 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:38.835428 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-e6d2deb7-87f3-4986-9149-47ad7335dc95 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61" status: 200 len: 1322 microversion: 2.1 time: 0.188697 Jun 30 12:33:38.836551 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 52/100] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:38 2022] GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61 => generated 1322 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:33:39.098523 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-bc0eea4a-b208-41fb-8eb3-9f9a8e5ac611 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:39.099111 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-bc0eea4a-b208-41fb-8eb3-9f9a8e5ac611 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 99ba3b96-6700-41e0-b2cf-ff8933b2bf94] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:39.101755 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-9eb3054d-ef0f-4954-aac2-e371c15f5af8 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:39.102856 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-9eb3054d-ef0f-4954-aac2-e371c15f5af8 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] [instance: 13f18862-cd59-44c8-a5c7-08d003e51e26] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:39.108653 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-bc0eea4a-b208-41fb-8eb3-9f9a8e5ac611 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:39.109115 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-bc0eea4a-b208-41fb-8eb3-9f9a8e5ac611 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:39.109891 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-bc0eea4a-b208-41fb-8eb3-9f9a8e5ac611 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:39.110406 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-bc0eea4a-b208-41fb-8eb3-9f9a8e5ac611 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:39.112151 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-9eb3054d-ef0f-4954-aac2-e371c15f5af8 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:39.116928 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-9eb3054d-ef0f-4954-aac2-e371c15f5af8 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:39.117812 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-9eb3054d-ef0f-4954-aac2-e371c15f5af8 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:39.118502 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-9eb3054d-ef0f-4954-aac2-e371c15f5af8 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:39.426523 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-bc0eea4a-b208-41fb-8eb3-9f9a8e5ac611 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddb38b4d6864a6c96b84c9a4092eea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60d10dba1d947cc97149a063a810129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:39.453153 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-bc0eea4a-b208-41fb-8eb3-9f9a8e5ac611 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94" status: 200 len: 1361 microversion: 2.1 time: 0.358661 Jun 30 12:33:39.456564 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 49/101] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:39 2022] GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94 => generated 1361 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:33:39.459757 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-9eb3054d-ef0f-4954-aac2-e371c15f5af8 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b688425466947198520ec7554bb49f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe4f134e4084a878a5e5cf59d96630f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:39.471534 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-9eb3054d-ef0f-4954-aac2-e371c15f5af8 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] 10.222.0.57 "GET /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26" status: 200 len: 1315 microversion: 2.1 time: 0.373651 Jun 30 12:33:39.472086 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 53/102] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:39 2022] GET /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26 => generated 1315 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:33:39.853017 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-8b20a0a7-4f02-4e5e-874a-f236d03ad35f tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:39.853601 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-8b20a0a7-4f02-4e5e-874a-f236d03ad35f tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: a2fe3bb8-40b2-4dea-818a-083e0bc5fb61] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:39.861150 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-8b20a0a7-4f02-4e5e-874a-f236d03ad35f tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:39.862036 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-8b20a0a7-4f02-4e5e-874a-f236d03ad35f tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:39.862919 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-8b20a0a7-4f02-4e5e-874a-f236d03ad35f tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:39.863345 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-8b20a0a7-4f02-4e5e-874a-f236d03ad35f tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:40.111704 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-8b20a0a7-4f02-4e5e-874a-f236d03ad35f tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:40.126010 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-8b20a0a7-4f02-4e5e-874a-f236d03ad35f tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61" status: 200 len: 1322 microversion: 2.1 time: 0.277251 Jun 30 12:33:40.126783 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 50/103] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:39 2022] GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61 => generated 1322 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:33:40.472432 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-3aad9c57-6dce-43e4-b9c3-e71f1ec0a116 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:40.473843 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-3aad9c57-6dce-43e4-b9c3-e71f1ec0a116 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 99ba3b96-6700-41e0-b2cf-ff8933b2bf94] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:40.480177 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-3aad9c57-6dce-43e4-b9c3-e71f1ec0a116 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:40.480936 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-3aad9c57-6dce-43e4-b9c3-e71f1ec0a116 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:40.482017 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-3aad9c57-6dce-43e4-b9c3-e71f1ec0a116 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:40.482517 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-3aad9c57-6dce-43e4-b9c3-e71f1ec0a116 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:40.489609 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-95da5962-d07a-4f4e-8422-a13d4f6dce48 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:40.490783 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-95da5962-d07a-4f4e-8422-a13d4f6dce48 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] [instance: 13f18862-cd59-44c8-a5c7-08d003e51e26] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:40.492947 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG dbcounter [-] [124298] Writing DB stats nova_cell0:SELECT=2 {{(pid=124298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:33:40.508981 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-95da5962-d07a-4f4e-8422-a13d4f6dce48 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:40.510736 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-95da5962-d07a-4f4e-8422-a13d4f6dce48 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:40.512845 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-95da5962-d07a-4f4e-8422-a13d4f6dce48 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:40.515010 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-95da5962-d07a-4f4e-8422-a13d4f6dce48 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:40.623343 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG dbcounter [-] [124297] Writing DB stats nova_cell0:SELECT=2 {{(pid=124297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:33:40.656966 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-3aad9c57-6dce-43e4-b9c3-e71f1ec0a116 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddb38b4d6864a6c96b84c9a4092eea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60d10dba1d947cc97149a063a810129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:40.665916 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-3aad9c57-6dce-43e4-b9c3-e71f1ec0a116 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94" status: 200 len: 1361 microversion: 2.1 time: 0.197157 Jun 30 12:33:40.669405 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 54/104] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:40 2022] GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94 => generated 1361 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:33:40.760556 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-95da5962-d07a-4f4e-8422-a13d4f6dce48 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b688425466947198520ec7554bb49f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe4f134e4084a878a5e5cf59d96630f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:40.771415 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-95da5962-d07a-4f4e-8422-a13d4f6dce48 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] 10.222.0.57 "GET /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26" status: 200 len: 1315 microversion: 2.1 time: 0.285376 Jun 30 12:33:40.781119 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 51/105] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:40 2022] GET /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26 => generated 1315 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 12:33:41.154488 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-8f829079-52d1-497c-92fe-aacfae5d8ee1 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:41.155199 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-8f829079-52d1-497c-92fe-aacfae5d8ee1 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: a2fe3bb8-40b2-4dea-818a-083e0bc5fb61] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:41.162059 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-8f829079-52d1-497c-92fe-aacfae5d8ee1 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:41.162579 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-8f829079-52d1-497c-92fe-aacfae5d8ee1 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:41.163754 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-8f829079-52d1-497c-92fe-aacfae5d8ee1 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:41.165132 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-8f829079-52d1-497c-92fe-aacfae5d8ee1 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:41.425822 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-8f829079-52d1-497c-92fe-aacfae5d8ee1 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:41.443085 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-8f829079-52d1-497c-92fe-aacfae5d8ee1 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61" status: 200 len: 1322 microversion: 2.1 time: 0.297693 Jun 30 12:33:41.443661 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 55/106] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:41 2022] GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61 => generated 1322 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:33:41.688738 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-f69d2081-dc06-4fb1-b21e-c18023a531c2 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:41.690091 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-f69d2081-dc06-4fb1-b21e-c18023a531c2 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 99ba3b96-6700-41e0-b2cf-ff8933b2bf94] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:41.702671 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-f69d2081-dc06-4fb1-b21e-c18023a531c2 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:41.703748 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-f69d2081-dc06-4fb1-b21e-c18023a531c2 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:41.705721 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-f69d2081-dc06-4fb1-b21e-c18023a531c2 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:41.708309 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-f69d2081-dc06-4fb1-b21e-c18023a531c2 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:41.852668 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [req-ceea7361-9018-4acd-bc1f-12f7a0f3a75a req-8cf3b130-32c7-4e43-b5aa-7eb545c96294 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13f18862-cd59-44c8-a5c7-08d003e51e26", "name": "network-vif-plugged", "status": "completed", "tag": "a1bc8255-e853-401f-8e86-93ea2467a967"}]} {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:33:41.872967 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [req-ceea7361-9018-4acd-bc1f-12f7a0f3a75a req-8cf3b130-32c7-4e43-b5aa-7eb545c96294 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:41.874514 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [req-ceea7361-9018-4acd-bc1f-12f7a0f3a75a req-8cf3b130-32c7-4e43-b5aa-7eb545c96294 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:41.899831 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.compute.server_external_events [req-ceea7361-9018-4acd-bc1f-12f7a0f3a75a req-8cf3b130-32c7-4e43-b5aa-7eb545c96294 service nova] Creating event network-vif-plugged:a1bc8255-e853-401f-8e86-93ea2467a967 for instance 13f18862-cd59-44c8-a5c7-08d003e51e26 on hv-cinder-84614 Jun 30 12:33:41.907107 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [req-ceea7361-9018-4acd-bc1f-12f7a0f3a75a req-8cf3b130-32c7-4e43-b5aa-7eb545c96294 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.294601 Jun 30 12:33:41.908160 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 52/107] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 30 12:33:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:33:41.914953 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-07f19c3c-2621-41c9-8aac-b31668ae7294 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:41.919092 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-07f19c3c-2621-41c9-8aac-b31668ae7294 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] [instance: 13f18862-cd59-44c8-a5c7-08d003e51e26] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:41.934706 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-f69d2081-dc06-4fb1-b21e-c18023a531c2 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddb38b4d6864a6c96b84c9a4092eea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60d10dba1d947cc97149a063a810129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:41.938678 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-07f19c3c-2621-41c9-8aac-b31668ae7294 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:41.940562 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-07f19c3c-2621-41c9-8aac-b31668ae7294 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:41.941641 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-07f19c3c-2621-41c9-8aac-b31668ae7294 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:41.942778 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-07f19c3c-2621-41c9-8aac-b31668ae7294 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:41.944971 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-f69d2081-dc06-4fb1-b21e-c18023a531c2 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94" status: 200 len: 1361 microversion: 2.1 time: 0.261838 Jun 30 12:33:41.949441 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 56/108] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:41 2022] GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94 => generated 1361 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:33:42.287506 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-07f19c3c-2621-41c9-8aac-b31668ae7294 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b688425466947198520ec7554bb49f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe4f134e4084a878a5e5cf59d96630f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:42.301214 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-07f19c3c-2621-41c9-8aac-b31668ae7294 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] 10.222.0.57 "GET /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26" status: 200 len: 1315 microversion: 2.1 time: 0.389557 Jun 30 12:33:42.301777 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 53/109] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:41 2022] GET /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26 => generated 1315 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:33:42.462386 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-0bae0472-d2bf-4acd-8952-372a2280f822 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:42.463255 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-0bae0472-d2bf-4acd-8952-372a2280f822 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: a2fe3bb8-40b2-4dea-818a-083e0bc5fb61] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:42.474367 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-0bae0472-d2bf-4acd-8952-372a2280f822 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:42.480066 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-0bae0472-d2bf-4acd-8952-372a2280f822 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:42.481021 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-0bae0472-d2bf-4acd-8952-372a2280f822 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:42.482257 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-0bae0472-d2bf-4acd-8952-372a2280f822 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:42.830137 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-0bae0472-d2bf-4acd-8952-372a2280f822 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:42.838968 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-0bae0472-d2bf-4acd-8952-372a2280f822 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61" status: 200 len: 1322 microversion: 2.1 time: 0.380881 Jun 30 12:33:42.848849 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 57/110] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:42 2022] GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61 => generated 1322 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:33:42.963852 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-2c757cc1-43cf-48c7-b007-938cf01c6be2 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:42.964570 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-2c757cc1-43cf-48c7-b007-938cf01c6be2 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 99ba3b96-6700-41e0-b2cf-ff8933b2bf94] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:42.973507 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-2c757cc1-43cf-48c7-b007-938cf01c6be2 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:42.973965 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-2c757cc1-43cf-48c7-b007-938cf01c6be2 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:42.974812 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-2c757cc1-43cf-48c7-b007-938cf01c6be2 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:42.975164 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-2c757cc1-43cf-48c7-b007-938cf01c6be2 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:43.204686 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-2c757cc1-43cf-48c7-b007-938cf01c6be2 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddb38b4d6864a6c96b84c9a4092eea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60d10dba1d947cc97149a063a810129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:43.213354 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-2c757cc1-43cf-48c7-b007-938cf01c6be2 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94" status: 200 len: 1361 microversion: 2.1 time: 0.254258 Jun 30 12:33:43.214664 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 54/111] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:42 2022] GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94 => generated 1361 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:33:43.320402 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-e9b5872e-4f91-4ef4-a319-52474cf4e054 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:43.321087 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-e9b5872e-4f91-4ef4-a319-52474cf4e054 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] [instance: 13f18862-cd59-44c8-a5c7-08d003e51e26] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:43.330810 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-e9b5872e-4f91-4ef4-a319-52474cf4e054 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:43.331266 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-e9b5872e-4f91-4ef4-a319-52474cf4e054 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:43.332297 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-e9b5872e-4f91-4ef4-a319-52474cf4e054 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:43.332766 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-e9b5872e-4f91-4ef4-a319-52474cf4e054 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:43.529717 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-e9b5872e-4f91-4ef4-a319-52474cf4e054 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b688425466947198520ec7554bb49f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe4f134e4084a878a5e5cf59d96630f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:43.541104 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-e9b5872e-4f91-4ef4-a319-52474cf4e054 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] 10.222.0.57 "GET /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26" status: 200 len: 1315 microversion: 2.1 time: 0.224595 Jun 30 12:33:43.541783 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 58/112] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:43 2022] GET /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26 => generated 1315 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:33:43.855345 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-81a817fb-ea76-44f9-8ee4-11ef91cdb979 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:43.856685 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-81a817fb-ea76-44f9-8ee4-11ef91cdb979 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: a2fe3bb8-40b2-4dea-818a-083e0bc5fb61] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:43.873168 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-81a817fb-ea76-44f9-8ee4-11ef91cdb979 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:43.873622 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-81a817fb-ea76-44f9-8ee4-11ef91cdb979 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:43.875308 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-81a817fb-ea76-44f9-8ee4-11ef91cdb979 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:43.875747 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-81a817fb-ea76-44f9-8ee4-11ef91cdb979 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:44.028359 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-81a817fb-ea76-44f9-8ee4-11ef91cdb979 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:44.036878 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-81a817fb-ea76-44f9-8ee4-11ef91cdb979 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61" status: 200 len: 1322 microversion: 2.1 time: 0.185330 Jun 30 12:33:44.037802 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 55/113] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:43 2022] GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61 => generated 1322 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:33:44.232959 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-0612a0fa-6d4a-4906-9d4e-83cc48868911 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:44.233576 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-0612a0fa-6d4a-4906-9d4e-83cc48868911 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 99ba3b96-6700-41e0-b2cf-ff8933b2bf94] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:44.240554 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-0612a0fa-6d4a-4906-9d4e-83cc48868911 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:44.241072 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-0612a0fa-6d4a-4906-9d4e-83cc48868911 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:44.241836 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-0612a0fa-6d4a-4906-9d4e-83cc48868911 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:44.242260 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-0612a0fa-6d4a-4906-9d4e-83cc48868911 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:44.389523 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-0612a0fa-6d4a-4906-9d4e-83cc48868911 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddb38b4d6864a6c96b84c9a4092eea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60d10dba1d947cc97149a063a810129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:44.397397 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-0612a0fa-6d4a-4906-9d4e-83cc48868911 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94" status: 200 len: 1361 microversion: 2.1 time: 0.170299 Jun 30 12:33:44.397994 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 59/114] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:44 2022] GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94 => generated 1361 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:33:44.559164 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-4f0f42c2-4ae7-4e34-a1a1-9e7da5870ff9 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:44.560069 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-4f0f42c2-4ae7-4e34-a1a1-9e7da5870ff9 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] [instance: 13f18862-cd59-44c8-a5c7-08d003e51e26] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:44.571238 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-4f0f42c2-4ae7-4e34-a1a1-9e7da5870ff9 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:44.572003 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-4f0f42c2-4ae7-4e34-a1a1-9e7da5870ff9 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:44.573941 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-4f0f42c2-4ae7-4e34-a1a1-9e7da5870ff9 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:44.576519 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-4f0f42c2-4ae7-4e34-a1a1-9e7da5870ff9 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:44.821848 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-4f0f42c2-4ae7-4e34-a1a1-9e7da5870ff9 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b688425466947198520ec7554bb49f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe4f134e4084a878a5e5cf59d96630f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:44.840926 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-4f0f42c2-4ae7-4e34-a1a1-9e7da5870ff9 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] 10.222.0.57 "GET /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26" status: 200 len: 1315 microversion: 2.1 time: 0.286418 Jun 30 12:33:44.842303 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 56/115] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:44 2022] GET /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26 => generated 1315 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:33:45.055316 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-44900bc8-aaaf-4ae4-ae0c-598c42faf5f8 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:45.056552 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-44900bc8-aaaf-4ae4-ae0c-598c42faf5f8 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: a2fe3bb8-40b2-4dea-818a-083e0bc5fb61] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:45.063409 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-44900bc8-aaaf-4ae4-ae0c-598c42faf5f8 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:45.063881 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-44900bc8-aaaf-4ae4-ae0c-598c42faf5f8 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:45.064752 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-44900bc8-aaaf-4ae4-ae0c-598c42faf5f8 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:45.065276 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-44900bc8-aaaf-4ae4-ae0c-598c42faf5f8 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:45.236861 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-44900bc8-aaaf-4ae4-ae0c-598c42faf5f8 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:45.245572 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-44900bc8-aaaf-4ae4-ae0c-598c42faf5f8 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61" status: 200 len: 1322 microversion: 2.1 time: 0.194908 Jun 30 12:33:45.246121 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 60/116] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:45 2022] GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61 => generated 1322 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:33:45.415388 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-e57f0e2b-dd02-49b9-be0a-52de14262b28 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:45.415388 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-e57f0e2b-dd02-49b9-be0a-52de14262b28 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 99ba3b96-6700-41e0-b2cf-ff8933b2bf94] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:45.428527 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-e57f0e2b-dd02-49b9-be0a-52de14262b28 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:45.429018 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-e57f0e2b-dd02-49b9-be0a-52de14262b28 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:45.429852 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-e57f0e2b-dd02-49b9-be0a-52de14262b28 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:45.430230 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-e57f0e2b-dd02-49b9-be0a-52de14262b28 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:45.578773 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-e57f0e2b-dd02-49b9-be0a-52de14262b28 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddb38b4d6864a6c96b84c9a4092eea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60d10dba1d947cc97149a063a810129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:45.587776 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-e57f0e2b-dd02-49b9-be0a-52de14262b28 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94" status: 200 len: 1361 microversion: 2.1 time: 0.177097 Jun 30 12:33:45.588778 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 57/117] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:45 2022] GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94 => generated 1361 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:33:45.864501 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-ead8418e-5bb7-40b2-8aae-9fa3994ba083 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:45.866337 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-ead8418e-5bb7-40b2-8aae-9fa3994ba083 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] [instance: 13f18862-cd59-44c8-a5c7-08d003e51e26] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:45.878572 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-ead8418e-5bb7-40b2-8aae-9fa3994ba083 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:45.879646 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-ead8418e-5bb7-40b2-8aae-9fa3994ba083 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:45.880817 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-ead8418e-5bb7-40b2-8aae-9fa3994ba083 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:45.881546 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-ead8418e-5bb7-40b2-8aae-9fa3994ba083 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:46.111412 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-ead8418e-5bb7-40b2-8aae-9fa3994ba083 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b688425466947198520ec7554bb49f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe4f134e4084a878a5e5cf59d96630f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:46.140929 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-ead8418e-5bb7-40b2-8aae-9fa3994ba083 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] 10.222.0.57 "GET /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26" status: 200 len: 1315 microversion: 2.1 time: 0.281722 Jun 30 12:33:46.142792 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 61/118] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:45 2022] GET /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26 => generated 1315 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:33:46.267518 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-0e0a5b9b-9500-4fd0-aafd-536807082ee4 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:46.267518 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-0e0a5b9b-9500-4fd0-aafd-536807082ee4 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: a2fe3bb8-40b2-4dea-818a-083e0bc5fb61] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:46.272386 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-0e0a5b9b-9500-4fd0-aafd-536807082ee4 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:46.273097 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-0e0a5b9b-9500-4fd0-aafd-536807082ee4 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:46.274278 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-0e0a5b9b-9500-4fd0-aafd-536807082ee4 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:46.276730 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-0e0a5b9b-9500-4fd0-aafd-536807082ee4 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:46.432781 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-0e0a5b9b-9500-4fd0-aafd-536807082ee4 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:46.440886 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-0e0a5b9b-9500-4fd0-aafd-536807082ee4 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61" status: 200 len: 1322 microversion: 2.1 time: 0.181821 Jun 30 12:33:46.441452 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 58/119] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:46 2022] GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61 => generated 1322 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:33:46.606059 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-bad34345-5448-48c1-be50-5bd591b4b48b tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:46.606735 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-bad34345-5448-48c1-be50-5bd591b4b48b tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 99ba3b96-6700-41e0-b2cf-ff8933b2bf94] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:46.613065 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-bad34345-5448-48c1-be50-5bd591b4b48b tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:46.613514 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-bad34345-5448-48c1-be50-5bd591b4b48b tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:46.614399 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-bad34345-5448-48c1-be50-5bd591b4b48b tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:46.614860 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-bad34345-5448-48c1-be50-5bd591b4b48b tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:46.765971 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-bad34345-5448-48c1-be50-5bd591b4b48b tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddb38b4d6864a6c96b84c9a4092eea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60d10dba1d947cc97149a063a810129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:46.773850 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-bad34345-5448-48c1-be50-5bd591b4b48b tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94" status: 200 len: 1361 microversion: 2.1 time: 0.171788 Jun 30 12:33:46.774565 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 62/120] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:46 2022] GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94 => generated 1361 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:33:47.158875 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-f64ddbf6-be5f-4995-93e9-44153ab04796 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:47.159507 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-f64ddbf6-be5f-4995-93e9-44153ab04796 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] [instance: 13f18862-cd59-44c8-a5c7-08d003e51e26] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:47.165705 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-f64ddbf6-be5f-4995-93e9-44153ab04796 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:47.166146 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-f64ddbf6-be5f-4995-93e9-44153ab04796 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:47.166903 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-f64ddbf6-be5f-4995-93e9-44153ab04796 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:47.167353 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-f64ddbf6-be5f-4995-93e9-44153ab04796 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:47.321721 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-f64ddbf6-be5f-4995-93e9-44153ab04796 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b688425466947198520ec7554bb49f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe4f134e4084a878a5e5cf59d96630f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:47.329537 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-f64ddbf6-be5f-4995-93e9-44153ab04796 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] 10.222.0.57 "GET /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26" status: 200 len: 1315 microversion: 2.1 time: 0.175037 Jun 30 12:33:47.330107 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 59/121] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:47 2022] GET /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26 => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 12:33:47.461326 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-4cd06466-af04-46f1-805f-3074b16ce76d tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:47.461938 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-4cd06466-af04-46f1-805f-3074b16ce76d tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: a2fe3bb8-40b2-4dea-818a-083e0bc5fb61] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:47.468083 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-4cd06466-af04-46f1-805f-3074b16ce76d tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:47.468529 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-4cd06466-af04-46f1-805f-3074b16ce76d tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:47.469321 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-4cd06466-af04-46f1-805f-3074b16ce76d tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:47.469765 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-4cd06466-af04-46f1-805f-3074b16ce76d tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:47.597186 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-4cd06466-af04-46f1-805f-3074b16ce76d tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:47.604531 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-4cd06466-af04-46f1-805f-3074b16ce76d tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61" status: 200 len: 1322 microversion: 2.1 time: 0.147994 Jun 30 12:33:47.605135 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 63/122] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:47 2022] GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:33:47.790521 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-5f92afcc-90c1-43ca-b137-0335e8b289e2 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:47.791148 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-5f92afcc-90c1-43ca-b137-0335e8b289e2 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 99ba3b96-6700-41e0-b2cf-ff8933b2bf94] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:47.797732 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-5f92afcc-90c1-43ca-b137-0335e8b289e2 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:47.798190 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-5f92afcc-90c1-43ca-b137-0335e8b289e2 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:47.799151 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-5f92afcc-90c1-43ca-b137-0335e8b289e2 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:47.799604 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-5f92afcc-90c1-43ca-b137-0335e8b289e2 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:47.939003 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-5f92afcc-90c1-43ca-b137-0335e8b289e2 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddb38b4d6864a6c96b84c9a4092eea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60d10dba1d947cc97149a063a810129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:47.947003 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-5f92afcc-90c1-43ca-b137-0335e8b289e2 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94" status: 200 len: 1361 microversion: 2.1 time: 0.160668 Jun 30 12:33:47.947573 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 60/123] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:47 2022] GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94 => generated 1361 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:33:48.346640 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-7807af15-9493-429f-bf14-69ae81ed59a4 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:48.347236 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-7807af15-9493-429f-bf14-69ae81ed59a4 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] [instance: 13f18862-cd59-44c8-a5c7-08d003e51e26] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:48.354394 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-7807af15-9493-429f-bf14-69ae81ed59a4 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:48.354839 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-7807af15-9493-429f-bf14-69ae81ed59a4 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:48.355855 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-7807af15-9493-429f-bf14-69ae81ed59a4 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:48.356079 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-7807af15-9493-429f-bf14-69ae81ed59a4 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:48.523093 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-7807af15-9493-429f-bf14-69ae81ed59a4 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b688425466947198520ec7554bb49f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe4f134e4084a878a5e5cf59d96630f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:48.535968 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-7807af15-9493-429f-bf14-69ae81ed59a4 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] 10.222.0.57 "GET /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26" status: 200 len: 1315 microversion: 2.1 time: 0.192946 Jun 30 12:33:48.540727 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 64/124] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:48 2022] GET /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26 => generated 1315 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:33:48.622901 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-8a2eb715-67ce-4c93-ba9b-9454cb75b7a9 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:48.624154 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-8a2eb715-67ce-4c93-ba9b-9454cb75b7a9 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: a2fe3bb8-40b2-4dea-818a-083e0bc5fb61] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:48.630952 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-8a2eb715-67ce-4c93-ba9b-9454cb75b7a9 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:48.631773 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-8a2eb715-67ce-4c93-ba9b-9454cb75b7a9 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:48.632818 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-8a2eb715-67ce-4c93-ba9b-9454cb75b7a9 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:48.633268 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-8a2eb715-67ce-4c93-ba9b-9454cb75b7a9 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:48.776766 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-8a2eb715-67ce-4c93-ba9b-9454cb75b7a9 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:48.784926 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-8a2eb715-67ce-4c93-ba9b-9454cb75b7a9 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61" status: 200 len: 1322 microversion: 2.1 time: 0.166793 Jun 30 12:33:48.785512 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 61/125] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:48 2022] GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61 => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:33:48.964136 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-ada7a064-24d5-410e-a6d8-dedfef4a1da5 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:48.965228 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-ada7a064-24d5-410e-a6d8-dedfef4a1da5 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 99ba3b96-6700-41e0-b2cf-ff8933b2bf94] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:48.972320 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-ada7a064-24d5-410e-a6d8-dedfef4a1da5 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:48.973094 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-ada7a064-24d5-410e-a6d8-dedfef4a1da5 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:48.973972 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-ada7a064-24d5-410e-a6d8-dedfef4a1da5 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:48.974733 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-ada7a064-24d5-410e-a6d8-dedfef4a1da5 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:49.000273 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG dbcounter [-] [124297] Writing DB stats nova_cell1:SELECT=100 {{(pid=124297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:33:49.122274 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-ada7a064-24d5-410e-a6d8-dedfef4a1da5 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddb38b4d6864a6c96b84c9a4092eea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60d10dba1d947cc97149a063a810129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:49.130386 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-ada7a064-24d5-410e-a6d8-dedfef4a1da5 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94" status: 200 len: 1361 microversion: 2.1 time: 0.170949 Jun 30 12:33:49.131071 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 65/126] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:48 2022] GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94 => generated 1361 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:33:49.558546 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-5d2e951a-1080-486c-85de-319c54278463 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:49.560537 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-5d2e951a-1080-486c-85de-319c54278463 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] [instance: 13f18862-cd59-44c8-a5c7-08d003e51e26] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:49.567701 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-5d2e951a-1080-486c-85de-319c54278463 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:49.568334 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-5d2e951a-1080-486c-85de-319c54278463 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:49.569133 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-5d2e951a-1080-486c-85de-319c54278463 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:49.569717 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-5d2e951a-1080-486c-85de-319c54278463 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:49.748573 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-5d2e951a-1080-486c-85de-319c54278463 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b688425466947198520ec7554bb49f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe4f134e4084a878a5e5cf59d96630f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:49.760876 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-5d2e951a-1080-486c-85de-319c54278463 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] 10.222.0.57 "GET /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26" status: 200 len: 1315 microversion: 2.1 time: 0.206584 Jun 30 12:33:49.761404 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 62/127] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:49 2022] GET /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26 => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:33:49.807085 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-db3e4ad0-03c3-44d8-b887-64a0302fe558 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:49.808877 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-db3e4ad0-03c3-44d8-b887-64a0302fe558 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: a2fe3bb8-40b2-4dea-818a-083e0bc5fb61] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:49.819194 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-db3e4ad0-03c3-44d8-b887-64a0302fe558 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:49.820371 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-db3e4ad0-03c3-44d8-b887-64a0302fe558 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:49.822774 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-db3e4ad0-03c3-44d8-b887-64a0302fe558 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:49.824346 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-db3e4ad0-03c3-44d8-b887-64a0302fe558 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:50.032319 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-db3e4ad0-03c3-44d8-b887-64a0302fe558 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:50.041030 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-db3e4ad0-03c3-44d8-b887-64a0302fe558 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61" status: 200 len: 1322 microversion: 2.1 time: 0.241928 Jun 30 12:33:50.041606 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 66/128] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:49 2022] GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61 => generated 1322 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:33:50.147956 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-703c4f8a-8a8c-4484-bceb-1b56a51cfcb9 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:50.148779 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-703c4f8a-8a8c-4484-bceb-1b56a51cfcb9 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 99ba3b96-6700-41e0-b2cf-ff8933b2bf94] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:50.155910 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-703c4f8a-8a8c-4484-bceb-1b56a51cfcb9 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:50.156603 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-703c4f8a-8a8c-4484-bceb-1b56a51cfcb9 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:50.157467 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-703c4f8a-8a8c-4484-bceb-1b56a51cfcb9 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:50.157968 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-703c4f8a-8a8c-4484-bceb-1b56a51cfcb9 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:50.311639 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-703c4f8a-8a8c-4484-bceb-1b56a51cfcb9 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddb38b4d6864a6c96b84c9a4092eea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60d10dba1d947cc97149a063a810129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:50.321955 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-703c4f8a-8a8c-4484-bceb-1b56a51cfcb9 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94" status: 200 len: 1361 microversion: 2.1 time: 0.178157 Jun 30 12:33:50.324256 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 63/129] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:50 2022] GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94 => generated 1361 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:33:50.720566 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [req-d3f47d58-0d7a-42af-9e44-2a372b8a7c70 req-cbe25709-cc8a-4067-b444-d4a6271c2cd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99ba3b96-6700-41e0-b2cf-ff8933b2bf94", "name": "network-vif-plugged", "status": "completed", "tag": "3cb03b0c-2687-4749-9a21-f441e6a23823"}]} {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:33:50.724487 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG dbcounter [-] [124297] Writing DB stats nova_api:SELECT=78 {{(pid=124297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:33:50.730580 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [req-d3f47d58-0d7a-42af-9e44-2a372b8a7c70 req-cbe25709-cc8a-4067-b444-d4a6271c2cd8 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:50.731307 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [req-d3f47d58-0d7a-42af-9e44-2a372b8a7c70 req-cbe25709-cc8a-4067-b444-d4a6271c2cd8 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:50.744734 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.compute.server_external_events [req-d3f47d58-0d7a-42af-9e44-2a372b8a7c70 req-cbe25709-cc8a-4067-b444-d4a6271c2cd8 service nova] Creating event network-vif-plugged:3cb03b0c-2687-4749-9a21-f441e6a23823 for instance 99ba3b96-6700-41e0-b2cf-ff8933b2bf94 on hv-cinder-84614 Jun 30 12:33:50.750961 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [req-d3f47d58-0d7a-42af-9e44-2a372b8a7c70 req-cbe25709-cc8a-4067-b444-d4a6271c2cd8 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033999 Jun 30 12:33:50.751736 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 67/130] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 30 12:33:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:33:50.778935 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-e0ad0538-162c-4272-9dfb-126c67dfd6f1 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:50.779681 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-e0ad0538-162c-4272-9dfb-126c67dfd6f1 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] [instance: 13f18862-cd59-44c8-a5c7-08d003e51e26] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:50.785801 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-e0ad0538-162c-4272-9dfb-126c67dfd6f1 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:50.786236 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-e0ad0538-162c-4272-9dfb-126c67dfd6f1 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:50.786981 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-e0ad0538-162c-4272-9dfb-126c67dfd6f1 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:50.787401 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-e0ad0538-162c-4272-9dfb-126c67dfd6f1 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:50.965159 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-e0ad0538-162c-4272-9dfb-126c67dfd6f1 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b688425466947198520ec7554bb49f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe4f134e4084a878a5e5cf59d96630f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:50.980462 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-e0ad0538-162c-4272-9dfb-126c67dfd6f1 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] 10.222.0.57 "GET /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26" status: 200 len: 1315 microversion: 2.1 time: 0.205757 Jun 30 12:33:50.981892 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 64/131] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:50 2022] GET /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26 => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:33:51.069696 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-4e67efb0-d27f-47c2-851f-e0b10ff385ba tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:51.071991 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-4e67efb0-d27f-47c2-851f-e0b10ff385ba tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: a2fe3bb8-40b2-4dea-818a-083e0bc5fb61] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:51.102365 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-4e67efb0-d27f-47c2-851f-e0b10ff385ba tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:51.104788 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-4e67efb0-d27f-47c2-851f-e0b10ff385ba tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:51.110368 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-4e67efb0-d27f-47c2-851f-e0b10ff385ba tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:51.111065 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-4e67efb0-d27f-47c2-851f-e0b10ff385ba tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:51.333353 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-4e67efb0-d27f-47c2-851f-e0b10ff385ba tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:51.344371 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-4e67efb0-d27f-47c2-851f-e0b10ff385ba tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61" status: 200 len: 1322 microversion: 2.1 time: 0.287724 Jun 30 12:33:51.344932 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-3b04f76d-caf2-4a7d-ab97-60e22572aa39 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:51.345395 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-3b04f76d-caf2-4a7d-ab97-60e22572aa39 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 99ba3b96-6700-41e0-b2cf-ff8933b2bf94] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:51.346056 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 68/132] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:51 2022] GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61 => generated 1322 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:33:51.367851 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-3b04f76d-caf2-4a7d-ab97-60e22572aa39 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:51.368320 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-3b04f76d-caf2-4a7d-ab97-60e22572aa39 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:51.371105 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-3b04f76d-caf2-4a7d-ab97-60e22572aa39 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:51.371575 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-3b04f76d-caf2-4a7d-ab97-60e22572aa39 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:51.403084 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG dbcounter [-] [124298] Writing DB stats nova_cell1:SELECT=100 {{(pid=124298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:33:51.571381 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-3b04f76d-caf2-4a7d-ab97-60e22572aa39 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddb38b4d6864a6c96b84c9a4092eea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60d10dba1d947cc97149a063a810129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:51.581208 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-3b04f76d-caf2-4a7d-ab97-60e22572aa39 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94" status: 200 len: 1361 microversion: 2.1 time: 0.244674 Jun 30 12:33:51.582450 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 65/133] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:51 2022] GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94 => generated 1361 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:33:51.999806 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-ccb83bcc-4932-4198-a1c0-df80fac28481 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:52.001296 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-ccb83bcc-4932-4198-a1c0-df80fac28481 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] [instance: 13f18862-cd59-44c8-a5c7-08d003e51e26] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:52.007645 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-ccb83bcc-4932-4198-a1c0-df80fac28481 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:52.008485 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-ccb83bcc-4932-4198-a1c0-df80fac28481 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:52.010244 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-ccb83bcc-4932-4198-a1c0-df80fac28481 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:52.010998 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-ccb83bcc-4932-4198-a1c0-df80fac28481 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:52.198828 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-ccb83bcc-4932-4198-a1c0-df80fac28481 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b688425466947198520ec7554bb49f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe4f134e4084a878a5e5cf59d96630f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:52.207091 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-ccb83bcc-4932-4198-a1c0-df80fac28481 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] 10.222.0.57 "GET /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26" status: 200 len: 1502 microversion: 2.1 time: 0.211852 Jun 30 12:33:52.207689 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 69/134] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:51 2022] GET /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26 => generated 1502 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:33:52.362973 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-020c1b05-2fc6-4f75-b21f-4cc51c6b41dc tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:52.363723 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-020c1b05-2fc6-4f75-b21f-4cc51c6b41dc tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: a2fe3bb8-40b2-4dea-818a-083e0bc5fb61] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:52.371713 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-020c1b05-2fc6-4f75-b21f-4cc51c6b41dc tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:52.372409 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-020c1b05-2fc6-4f75-b21f-4cc51c6b41dc tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:52.373398 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-020c1b05-2fc6-4f75-b21f-4cc51c6b41dc tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:52.373987 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-020c1b05-2fc6-4f75-b21f-4cc51c6b41dc tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:52.601412 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-9c954569-c743-4f6e-bd4c-a1595a069bf9 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:52.603075 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-9c954569-c743-4f6e-bd4c-a1595a069bf9 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 99ba3b96-6700-41e0-b2cf-ff8933b2bf94] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:52.610748 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-020c1b05-2fc6-4f75-b21f-4cc51c6b41dc tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:52.621947 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-020c1b05-2fc6-4f75-b21f-4cc51c6b41dc tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61" status: 200 len: 1322 microversion: 2.1 time: 0.262151 Jun 30 12:33:52.623691 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 66/135] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:52 2022] GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61 => generated 1322 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:33:52.629692 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-9c954569-c743-4f6e-bd4c-a1595a069bf9 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:52.630514 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-9c954569-c743-4f6e-bd4c-a1595a069bf9 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:52.631657 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-9c954569-c743-4f6e-bd4c-a1595a069bf9 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:52.633001 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-9c954569-c743-4f6e-bd4c-a1595a069bf9 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:52.785664 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [req-6ebd3cfa-689f-4a40-bd9d-1d58f13ed98d req-b1d105c3-e814-4e9b-8f2c-2183c7b258e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2fe3bb8-40b2-4dea-818a-083e0bc5fb61", "name": "network-vif-plugged", "status": "completed", "tag": "7141f81e-2130-4ea4-bd66-d50c16384aaf"}, {"server_uuid": "99a31213-cbcb-4b2c-b07f-ab67e78a2096", "name": "network-vif-plugged", "status": "completed", "tag": "cedc0eef-3278-4f0e-aa08-b47c9f4b77c6"}]} {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:33:52.803977 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [req-6ebd3cfa-689f-4a40-bd9d-1d58f13ed98d req-b1d105c3-e814-4e9b-8f2c-2183c7b258e4 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:52.804550 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [req-6ebd3cfa-689f-4a40-bd9d-1d58f13ed98d req-b1d105c3-e814-4e9b-8f2c-2183c7b258e4 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:52.834688 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.compute.server_external_events [req-6ebd3cfa-689f-4a40-bd9d-1d58f13ed98d req-b1d105c3-e814-4e9b-8f2c-2183c7b258e4 service nova] Creating event network-vif-plugged:7141f81e-2130-4ea4-bd66-d50c16384aaf for instance a2fe3bb8-40b2-4dea-818a-083e0bc5fb61 on hv-cinder-84614 Jun 30 12:33:52.838130 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.compute.server_external_events [req-6ebd3cfa-689f-4a40-bd9d-1d58f13ed98d req-b1d105c3-e814-4e9b-8f2c-2183c7b258e4 service nova] Creating event network-vif-plugged:cedc0eef-3278-4f0e-aa08-b47c9f4b77c6 for instance 99a31213-cbcb-4b2c-b07f-ab67e78a2096 on hv-cinder-84614 Jun 30 12:33:52.853077 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [req-6ebd3cfa-689f-4a40-bd9d-1d58f13ed98d req-b1d105c3-e814-4e9b-8f2c-2183c7b258e4 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.072387 Jun 30 12:33:52.855424 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 67/136] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 30 12:33:52 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 12:33:52.926783 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-9c954569-c743-4f6e-bd4c-a1595a069bf9 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddb38b4d6864a6c96b84c9a4092eea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60d10dba1d947cc97149a063a810129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:52.936184 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-9c954569-c743-4f6e-bd4c-a1595a069bf9 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94" status: 200 len: 1361 microversion: 2.1 time: 0.340314 Jun 30 12:33:52.939454 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 70/137] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:52 2022] GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94 => generated 1361 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 12:33:53.643157 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-b1cd0920-aa86-496e-86f3-a45997c9552c tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:53.643913 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-b1cd0920-aa86-496e-86f3-a45997c9552c tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: a2fe3bb8-40b2-4dea-818a-083e0bc5fb61] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:53.655633 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-b1cd0920-aa86-496e-86f3-a45997c9552c tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:53.656005 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-b1cd0920-aa86-496e-86f3-a45997c9552c tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:53.657966 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-b1cd0920-aa86-496e-86f3-a45997c9552c tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:53.658751 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-b1cd0920-aa86-496e-86f3-a45997c9552c tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:53.909996 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-4bc7c703-750a-4f83-a35e-92d7746dd9a2 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2eee9c52-5c8e-434d-aa93-4d351d75db47"}} {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:33:53.913869 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-4bc7c703-750a-4f83-a35e-92d7746dd9a2 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] [instance: 13f18862-cd59-44c8-a5c7-08d003e51e26] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:53.942235 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-4bc7c703-750a-4f83-a35e-92d7746dd9a2 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:53.942693 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-4bc7c703-750a-4f83-a35e-92d7746dd9a2 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:53.946039 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-4bc7c703-750a-4f83-a35e-92d7746dd9a2 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:53.946535 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-4bc7c703-750a-4f83-a35e-92d7746dd9a2 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:54.032435 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-b1cd0920-aa86-496e-86f3-a45997c9552c tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:54.045353 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-b1cd0920-aa86-496e-86f3-a45997c9552c tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61" status: 200 len: 1322 microversion: 2.1 time: 0.408532 Jun 30 12:33:54.050226 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 68/138] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:53 2022] GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61 => generated 1322 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:33:54.063841 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-b3462a99-17d4-4347-992d-2c78e7e0d052 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:54.066010 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-b3462a99-17d4-4347-992d-2c78e7e0d052 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 99ba3b96-6700-41e0-b2cf-ff8933b2bf94] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:54.075188 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-b3462a99-17d4-4347-992d-2c78e7e0d052 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:54.076123 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-b3462a99-17d4-4347-992d-2c78e7e0d052 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:54.077317 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-b3462a99-17d4-4347-992d-2c78e7e0d052 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:54.078476 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-b3462a99-17d4-4347-992d-2c78e7e0d052 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:54.354703 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-b3462a99-17d4-4347-992d-2c78e7e0d052 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddb38b4d6864a6c96b84c9a4092eea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60d10dba1d947cc97149a063a810129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:54.367709 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-b3462a99-17d4-4347-992d-2c78e7e0d052 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94" status: 200 len: 1548 microversion: 2.1 time: 0.311907 Jun 30 12:33:54.370136 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 69/139] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:54 2022] GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94 => generated 1548 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:33:54.390643 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-29151aeb-f9fb-43f1-b8fc-d7e1cdb8d1d1 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:54.391285 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-29151aeb-f9fb-43f1-b8fc-d7e1cdb8d1d1 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 99ba3b96-6700-41e0-b2cf-ff8933b2bf94] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:54.401961 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-29151aeb-f9fb-43f1-b8fc-d7e1cdb8d1d1 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:54.404114 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-29151aeb-f9fb-43f1-b8fc-d7e1cdb8d1d1 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:54.405487 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-29151aeb-f9fb-43f1-b8fc-d7e1cdb8d1d1 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:54.406551 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-29151aeb-f9fb-43f1-b8fc-d7e1cdb8d1d1 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:54.619089 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-29151aeb-f9fb-43f1-b8fc-d7e1cdb8d1d1 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.234195 Jun 30 12:33:54.620297 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 70/140] 10.222.0.57 () {58 vars in 1274 bytes} [Thu Jun 30 12:33:54 2022] GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94/os-interface => generated 285 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 12:33:55.066276 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-2546ba95-ca32-4ea5-ad1e-e9e006bdada3 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:55.067619 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-2546ba95-ca32-4ea5-ad1e-e9e006bdada3 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: a2fe3bb8-40b2-4dea-818a-083e0bc5fb61] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:55.079194 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-2546ba95-ca32-4ea5-ad1e-e9e006bdada3 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:55.079662 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-2546ba95-ca32-4ea5-ad1e-e9e006bdada3 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:55.080425 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-2546ba95-ca32-4ea5-ad1e-e9e006bdada3 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:55.080925 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-2546ba95-ca32-4ea5-ad1e-e9e006bdada3 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:55.340620 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-2546ba95-ca32-4ea5-ad1e-e9e006bdada3 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:55.350609 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-2546ba95-ca32-4ea5-ad1e-e9e006bdada3 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61" status: 200 len: 1322 microversion: 2.1 time: 0.288251 Jun 30 12:33:55.360313 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 71/141] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:55 2022] GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61 => generated 1322 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 12:33:55.869951 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-99d69e02-195f-48e0-81ec-287dd2432d06 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-224574543", "imageRef": "776a1662-a241-4e20-9a9c-e4743c64efd0", "flavorRef": "452"}} {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:33:55.931479 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.network.neutron [None req-99d69e02-195f-48e0-81ec-287dd2432d06 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] validate_networks() for None {{(pid=124298) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 12:33:56.570125 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-4bc7c703-750a-4f83-a35e-92d7746dd9a2 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] 10.222.0.57 "POST /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.678964 Jun 30 12:33:56.571767 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 71/142] 10.222.0.57 () {60 vars in 1322 bytes} [Thu Jun 30 12:33:53 2022] POST /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26/os-volume_attachments => generated 194 bytes in 2683 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:33:56.589039 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-cf184607-cd2f-4284-b2a5-6f9f540958a4 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:56.590503 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-cf184607-cd2f-4284-b2a5-6f9f540958a4 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: a2fe3bb8-40b2-4dea-818a-083e0bc5fb61] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:56.613067 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-cf184607-cd2f-4284-b2a5-6f9f540958a4 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:56.614203 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-cf184607-cd2f-4284-b2a5-6f9f540958a4 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:56.615256 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-cf184607-cd2f-4284-b2a5-6f9f540958a4 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:56.615901 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-cf184607-cd2f-4284-b2a5-6f9f540958a4 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:56.936655 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-cf184607-cd2f-4284-b2a5-6f9f540958a4 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:56.945711 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-cf184607-cd2f-4284-b2a5-6f9f540958a4 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61" status: 200 len: 1517 microversion: 2.1 time: 0.370030 Jun 30 12:33:56.946298 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 72/143] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:56 2022] GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61 => generated 1517 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:33:56.964956 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [req-7699148d-bace-4ddb-96f9-f1aefc0db2fc req-79255f00-d568-4a10-b2ab-aa58d23ccbce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99ba3b96-6700-41e0-b2cf-ff8933b2bf94", "tag": "3cb03b0c-2687-4749-9a21-f441e6a23823"}]} {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:33:56.974461 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [req-7699148d-bace-4ddb-96f9-f1aefc0db2fc req-79255f00-d568-4a10-b2ab-aa58d23ccbce service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:56.975121 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [req-7699148d-bace-4ddb-96f9-f1aefc0db2fc req-79255f00-d568-4a10-b2ab-aa58d23ccbce service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:56.989781 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.compute.server_external_events [req-7699148d-bace-4ddb-96f9-f1aefc0db2fc req-79255f00-d568-4a10-b2ab-aa58d23ccbce service nova] Creating event network-changed:3cb03b0c-2687-4749-9a21-f441e6a23823 for instance 99ba3b96-6700-41e0-b2cf-ff8933b2bf94 on hv-cinder-84614 Jun 30 12:33:56.995316 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [req-7699148d-bace-4ddb-96f9-f1aefc0db2fc req-79255f00-d568-4a10-b2ab-aa58d23ccbce service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035794 Jun 30 12:33:56.996680 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 73/144] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 30 12:33:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:33:57.005312 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.virt.hardware [None req-99d69e02-195f-48e0-81ec-287dd2432d06 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Flavor limits 0:0:0 {{(pid=124298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 12:33:57.005850 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.virt.hardware [None req-99d69e02-195f-48e0-81ec-287dd2432d06 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Image limits 0:0:0 {{(pid=124298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 12:33:57.006243 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.virt.hardware [None req-99d69e02-195f-48e0-81ec-287dd2432d06 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Flavor pref 0:0:0 {{(pid=124298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 12:33:57.006854 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.virt.hardware [None req-99d69e02-195f-48e0-81ec-287dd2432d06 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Image pref 0:0:0 {{(pid=124298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 12:33:57.007592 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.virt.hardware [None req-99d69e02-195f-48e0-81ec-287dd2432d06 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 12:33:57.007885 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-d6929f84-bc1f-4038-9fdc-241b3fd44585 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:33:57.009327 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-d6929f84-bc1f-4038-9fdc-241b3fd44585 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: a2fe3bb8-40b2-4dea-818a-083e0bc5fb61] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:57.017275 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-d6929f84-bc1f-4038-9fdc-241b3fd44585 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:57.018646 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-d6929f84-bc1f-4038-9fdc-241b3fd44585 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:57.020144 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-d6929f84-bc1f-4038-9fdc-241b3fd44585 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:57.020929 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-d6929f84-bc1f-4038-9fdc-241b3fd44585 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:57.034119 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-99d69e02-195f-48e0-81ec-287dd2432d06 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:57.035815 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-99d69e02-195f-48e0-81ec-287dd2432d06 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:57.037009 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-99d69e02-195f-48e0-81ec-287dd2432d06 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:57.038065 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-99d69e02-195f-48e0-81ec-287dd2432d06 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:57.067602 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.quota [None req-99d69e02-195f-48e0-81ec-287dd2432d06 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Getting quotas for project 48748543262c417d9089326f428e6b63. Resources: {'cores', 'ram', 'instances'} {{(pid=124298) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 12:33:57.072471 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.quota [None req-99d69e02-195f-48e0-81ec-287dd2432d06 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Getting quotas for user c969fad4feb7468abd62714899d3fc2b and project 48748543262c417d9089326f428e6b63. Resources: {'cores', 'ram', 'instances'} {{(pid=124298) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 12:33:57.073960 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.objects.instance [None req-d6929f84-bc1f-4038-9fdc-241b3fd44585 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lazy-loading 'flavor' on Instance uuid a2fe3bb8-40b2-4dea-818a-083e0bc5fb61 {{(pid=124297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 12:33:57.102908 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-99d69e02-195f-48e0-81ec-287dd2432d06 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Going to run 1 instances... {{(pid=124298) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 12:33:57.106770 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-99d69e02-195f-48e0-81ec-287dd2432d06 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] [instance: 3aa9e093-54e1-4388-b035-5f82bab9cd20] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='776a1662-a241-4e20-9a9c-e4743c64efd0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124298) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 12:33:57.236353 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-99d69e02-195f-48e0-81ec-287dd2432d06 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.370556 Jun 30 12:33:57.240733 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 72/145] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 30 12:33:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1376 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 12:33:57.260644 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-4c018c12-82d6-42ef-872e-705113224f62 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:57.261214 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-4c018c12-82d6-42ef-872e-705113224f62 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] [instance: 3aa9e093-54e1-4388-b035-5f82bab9cd20] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:57.319158 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-d6929f84-bc1f-4038-9fdc-241b3fd44585 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "POST /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61/action" status: 200 len: 32 microversion: 2.1 time: 0.320477 Jun 30 12:33:57.323692 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 74/146] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Jun 30 12:33:56 2022] POST /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61/action => generated 32 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 30 12:33:57.333244 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-045823c6-20bf-4c0d-b2cb-5be8c5531365 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:57.334011 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-045823c6-20bf-4c0d-b2cb-5be8c5531365 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: a2fe3bb8-40b2-4dea-818a-083e0bc5fb61] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:57.340693 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-4c018c12-82d6-42ef-872e-705113224f62 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c969fad4feb7468abd62714899d3fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48748543262c417d9089326f428e6b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:57.350241 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-045823c6-20bf-4c0d-b2cb-5be8c5531365 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:57.350689 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-045823c6-20bf-4c0d-b2cb-5be8c5531365 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:57.351474 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-045823c6-20bf-4c0d-b2cb-5be8c5531365 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:57.351901 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-045823c6-20bf-4c0d-b2cb-5be8c5531365 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:57.361303 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-4c018c12-82d6-42ef-872e-705113224f62 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] 10.222.0.57 "GET /compute/v2.1/servers/3aa9e093-54e1-4388-b035-5f82bab9cd20" status: 200 len: 1214 microversion: 2.1 time: 0.114304 Jun 30 12:33:57.362215 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 73/147] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:57 2022] GET /compute/v2.1/servers/3aa9e093-54e1-4388-b035-5f82bab9cd20 => generated 1214 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:33:57.620320 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-045823c6-20bf-4c0d-b2cb-5be8c5531365 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:57.631217 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-045823c6-20bf-4c0d-b2cb-5be8c5531365 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61" status: 200 len: 1523 microversion: 2.1 time: 0.305528 Jun 30 12:33:57.632158 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 75/148] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:57 2022] GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61 => generated 1523 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 12:33:58.381377 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-4509c816-8926-40fa-b502-a5518bdb9377 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:58.382674 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-4509c816-8926-40fa-b502-a5518bdb9377 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] [instance: 3aa9e093-54e1-4388-b035-5f82bab9cd20] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:58.387173 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG dbcounter [-] [124298] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=124298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:33:58.392381 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-4509c816-8926-40fa-b502-a5518bdb9377 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:58.392898 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-4509c816-8926-40fa-b502-a5518bdb9377 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:58.394757 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-4509c816-8926-40fa-b502-a5518bdb9377 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:58.395760 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-4509c816-8926-40fa-b502-a5518bdb9377 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:58.467240 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-4509c816-8926-40fa-b502-a5518bdb9377 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c969fad4feb7468abd62714899d3fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48748543262c417d9089326f428e6b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:58.474214 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-4509c816-8926-40fa-b502-a5518bdb9377 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] 10.222.0.57 "GET /compute/v2.1/servers/3aa9e093-54e1-4388-b035-5f82bab9cd20" status: 200 len: 1218 microversion: 2.1 time: 0.098357 Jun 30 12:33:58.475344 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 74/149] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:58 2022] GET /compute/v2.1/servers/3aa9e093-54e1-4388-b035-5f82bab9cd20 => generated 1218 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:33:58.647472 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-f66ab58b-ac4a-4621-8df6-c33be6859a33 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:58.648085 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-f66ab58b-ac4a-4621-8df6-c33be6859a33 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: a2fe3bb8-40b2-4dea-818a-083e0bc5fb61] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:58.656296 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-f66ab58b-ac4a-4621-8df6-c33be6859a33 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:58.657233 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-f66ab58b-ac4a-4621-8df6-c33be6859a33 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:58.658159 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-f66ab58b-ac4a-4621-8df6-c33be6859a33 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:58.659236 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-f66ab58b-ac4a-4621-8df6-c33be6859a33 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:58.810105 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-f66ab58b-ac4a-4621-8df6-c33be6859a33 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:58.819619 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-f66ab58b-ac4a-4621-8df6-c33be6859a33 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61" status: 200 len: 1523 microversion: 2.1 time: 0.176049 Jun 30 12:33:58.820405 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 76/150] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:58 2022] GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61 => generated 1523 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:33:59.495491 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-7083a78f-5185-4450-914b-2e31204cca14 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:59.496550 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-7083a78f-5185-4450-914b-2e31204cca14 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] [instance: 3aa9e093-54e1-4388-b035-5f82bab9cd20] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:59.503849 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-7083a78f-5185-4450-914b-2e31204cca14 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:59.504357 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-7083a78f-5185-4450-914b-2e31204cca14 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:59.505250 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-7083a78f-5185-4450-914b-2e31204cca14 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:59.505742 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-7083a78f-5185-4450-914b-2e31204cca14 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:59.573281 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-7083a78f-5185-4450-914b-2e31204cca14 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c969fad4feb7468abd62714899d3fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48748543262c417d9089326f428e6b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:33:59.581389 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-7083a78f-5185-4450-914b-2e31204cca14 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] 10.222.0.57 "GET /compute/v2.1/servers/3aa9e093-54e1-4388-b035-5f82bab9cd20" status: 200 len: 1218 microversion: 2.1 time: 0.092435 Jun 30 12:33:59.581953 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 75/151] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:59 2022] GET /compute/v2.1/servers/3aa9e093-54e1-4388-b035-5f82bab9cd20 => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:33:59.837517 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-f27b13cc-e4cf-48cb-ab53-71cb5ce44507 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:33:59.838127 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-f27b13cc-e4cf-48cb-ab53-71cb5ce44507 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: a2fe3bb8-40b2-4dea-818a-083e0bc5fb61] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:33:59.844822 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-f27b13cc-e4cf-48cb-ab53-71cb5ce44507 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:59.845331 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-f27b13cc-e4cf-48cb-ab53-71cb5ce44507 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:33:59.846127 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-f27b13cc-e4cf-48cb-ab53-71cb5ce44507 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:33:59.846540 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-f27b13cc-e4cf-48cb-ab53-71cb5ce44507 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:00.017030 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-f27b13cc-e4cf-48cb-ab53-71cb5ce44507 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:34:00.024609 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-f27b13cc-e4cf-48cb-ab53-71cb5ce44507 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61" status: 200 len: 1523 microversion: 2.1 time: 0.190896 Jun 30 12:34:00.025159 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 77/152] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:33:59 2022] GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61 => generated 1523 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:34:00.599993 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-1967e942-d7d3-48f1-86cd-8c5c95f7e68d tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:00.600648 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-1967e942-d7d3-48f1-86cd-8c5c95f7e68d tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] [instance: 3aa9e093-54e1-4388-b035-5f82bab9cd20] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:34:00.608069 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-1967e942-d7d3-48f1-86cd-8c5c95f7e68d tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:00.608844 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-1967e942-d7d3-48f1-86cd-8c5c95f7e68d tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:00.609617 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-1967e942-d7d3-48f1-86cd-8c5c95f7e68d tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:00.610016 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-1967e942-d7d3-48f1-86cd-8c5c95f7e68d tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:00.678837 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-1967e942-d7d3-48f1-86cd-8c5c95f7e68d tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c969fad4feb7468abd62714899d3fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48748543262c417d9089326f428e6b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:34:00.687119 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-1967e942-d7d3-48f1-86cd-8c5c95f7e68d tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] 10.222.0.57 "GET /compute/v2.1/servers/3aa9e093-54e1-4388-b035-5f82bab9cd20" status: 200 len: 1272 microversion: 2.1 time: 0.091526 Jun 30 12:34:00.687709 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 76/153] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:34:00 2022] GET /compute/v2.1/servers/3aa9e093-54e1-4388-b035-5f82bab9cd20 => generated 1272 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:34:01.045910 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-d4858e2c-8a5e-4ac6-b726-2c448edc5919 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:01.047283 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-d4858e2c-8a5e-4ac6-b726-2c448edc5919 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: a2fe3bb8-40b2-4dea-818a-083e0bc5fb61] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:34:01.055753 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-d4858e2c-8a5e-4ac6-b726-2c448edc5919 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:01.056415 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-d4858e2c-8a5e-4ac6-b726-2c448edc5919 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:01.057669 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-d4858e2c-8a5e-4ac6-b726-2c448edc5919 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:01.057957 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-d4858e2c-8a5e-4ac6-b726-2c448edc5919 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:01.214870 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-d4858e2c-8a5e-4ac6-b726-2c448edc5919 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:34:01.222598 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-d4858e2c-8a5e-4ac6-b726-2c448edc5919 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61" status: 200 len: 1523 microversion: 2.1 time: 0.182103 Jun 30 12:34:01.223378 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 78/154] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:34:01 2022] GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61 => generated 1523 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:34:01.704667 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-301436be-0ccb-4dbb-866c-217463ea51e8 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:01.705265 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-301436be-0ccb-4dbb-866c-217463ea51e8 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] [instance: 3aa9e093-54e1-4388-b035-5f82bab9cd20] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:34:01.711570 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-301436be-0ccb-4dbb-866c-217463ea51e8 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:01.712015 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-301436be-0ccb-4dbb-866c-217463ea51e8 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:01.712900 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-301436be-0ccb-4dbb-866c-217463ea51e8 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:01.713297 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-301436be-0ccb-4dbb-866c-217463ea51e8 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:01.776915 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-301436be-0ccb-4dbb-866c-217463ea51e8 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c969fad4feb7468abd62714899d3fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48748543262c417d9089326f428e6b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:34:01.785358 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-301436be-0ccb-4dbb-866c-217463ea51e8 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] 10.222.0.57 "GET /compute/v2.1/servers/3aa9e093-54e1-4388-b035-5f82bab9cd20" status: 200 len: 1272 microversion: 2.1 time: 0.084744 Jun 30 12:34:01.786502 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 77/155] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:34:01 2022] GET /compute/v2.1/servers/3aa9e093-54e1-4388-b035-5f82bab9cd20 => generated 1272 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:34:02.244845 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-15a527b7-7dc5-4a23-8efd-d4603c4be0e8 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:02.245428 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-15a527b7-7dc5-4a23-8efd-d4603c4be0e8 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: a2fe3bb8-40b2-4dea-818a-083e0bc5fb61] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:34:02.253053 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-15a527b7-7dc5-4a23-8efd-d4603c4be0e8 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:02.253495 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-15a527b7-7dc5-4a23-8efd-d4603c4be0e8 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:02.254282 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-15a527b7-7dc5-4a23-8efd-d4603c4be0e8 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:02.254702 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-15a527b7-7dc5-4a23-8efd-d4603c4be0e8 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:02.407919 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-15a527b7-7dc5-4a23-8efd-d4603c4be0e8 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:34:02.416622 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-15a527b7-7dc5-4a23-8efd-d4603c4be0e8 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61" status: 200 len: 1523 microversion: 2.1 time: 0.175672 Jun 30 12:34:02.417231 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 79/156] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:34:02 2022] GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61 => generated 1523 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:34:02.806315 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-7ecaa005-be10-4471-8725-93d6162783f8 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:02.806842 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-7ecaa005-be10-4471-8725-93d6162783f8 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] [instance: 3aa9e093-54e1-4388-b035-5f82bab9cd20] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:34:02.815632 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-7ecaa005-be10-4471-8725-93d6162783f8 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:02.816242 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-7ecaa005-be10-4471-8725-93d6162783f8 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:02.817342 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-7ecaa005-be10-4471-8725-93d6162783f8 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:02.817953 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-7ecaa005-be10-4471-8725-93d6162783f8 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:02.881065 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-7ecaa005-be10-4471-8725-93d6162783f8 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c969fad4feb7468abd62714899d3fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48748543262c417d9089326f428e6b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:34:02.889438 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-7ecaa005-be10-4471-8725-93d6162783f8 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] 10.222.0.57 "GET /compute/v2.1/servers/3aa9e093-54e1-4388-b035-5f82bab9cd20" status: 200 len: 1272 microversion: 2.1 time: 0.089595 Jun 30 12:34:02.890013 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 78/157] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:34:02 2022] GET /compute/v2.1/servers/3aa9e093-54e1-4388-b035-5f82bab9cd20 => generated 1272 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:34:03.437365 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-f5795b3f-da70-42fe-b845-07c9d3efd438 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:03.438880 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-f5795b3f-da70-42fe-b845-07c9d3efd438 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: a2fe3bb8-40b2-4dea-818a-083e0bc5fb61] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:34:03.446730 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-f5795b3f-da70-42fe-b845-07c9d3efd438 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:03.447414 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-f5795b3f-da70-42fe-b845-07c9d3efd438 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:03.448183 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-f5795b3f-da70-42fe-b845-07c9d3efd438 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:03.448610 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-f5795b3f-da70-42fe-b845-07c9d3efd438 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:03.453281 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG dbcounter [-] [124297] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:34:03.588276 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-f5795b3f-da70-42fe-b845-07c9d3efd438 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:34:03.597793 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-f5795b3f-da70-42fe-b845-07c9d3efd438 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61" status: 200 len: 1523 microversion: 2.1 time: 0.165306 Jun 30 12:34:03.598935 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 80/158] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:34:03 2022] GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61 => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:34:03.906395 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-99a20d06-49cf-45fc-94cd-9ae6f725013f tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:03.907011 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-99a20d06-49cf-45fc-94cd-9ae6f725013f tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] [instance: 3aa9e093-54e1-4388-b035-5f82bab9cd20] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:34:03.914197 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-99a20d06-49cf-45fc-94cd-9ae6f725013f tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:03.914860 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-99a20d06-49cf-45fc-94cd-9ae6f725013f tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:03.916111 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-99a20d06-49cf-45fc-94cd-9ae6f725013f tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:03.916745 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-99a20d06-49cf-45fc-94cd-9ae6f725013f tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:03.993701 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-99a20d06-49cf-45fc-94cd-9ae6f725013f tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c969fad4feb7468abd62714899d3fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48748543262c417d9089326f428e6b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:34:04.003264 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-99a20d06-49cf-45fc-94cd-9ae6f725013f tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] 10.222.0.57 "GET /compute/v2.1/servers/3aa9e093-54e1-4388-b035-5f82bab9cd20" status: 200 len: 1272 microversion: 2.1 time: 0.101007 Jun 30 12:34:04.003852 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 79/159] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:34:03 2022] GET /compute/v2.1/servers/3aa9e093-54e1-4388-b035-5f82bab9cd20 => generated 1272 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:34:04.618497 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-508e7d98-fcdb-416b-8f27-1a7d7add7010 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:04.619118 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-508e7d98-fcdb-416b-8f27-1a7d7add7010 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: a2fe3bb8-40b2-4dea-818a-083e0bc5fb61] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:34:04.643751 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-508e7d98-fcdb-416b-8f27-1a7d7add7010 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:04.645112 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-508e7d98-fcdb-416b-8f27-1a7d7add7010 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:04.646436 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-508e7d98-fcdb-416b-8f27-1a7d7add7010 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:04.647655 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-508e7d98-fcdb-416b-8f27-1a7d7add7010 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:04.826924 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-508e7d98-fcdb-416b-8f27-1a7d7add7010 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:34:04.839576 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-508e7d98-fcdb-416b-8f27-1a7d7add7010 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61" status: 200 len: 1523 microversion: 2.1 time: 0.226836 Jun 30 12:34:04.841736 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 81/160] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:34:04 2022] GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61 => generated 1523 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 12:34:05.024876 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-6f359b09-3410-4326-be9f-5d4dacbcbbbb tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:05.025837 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-6f359b09-3410-4326-be9f-5d4dacbcbbbb tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] [instance: 3aa9e093-54e1-4388-b035-5f82bab9cd20] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:34:05.039105 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-6f359b09-3410-4326-be9f-5d4dacbcbbbb tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:05.039832 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-6f359b09-3410-4326-be9f-5d4dacbcbbbb tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:05.041245 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-6f359b09-3410-4326-be9f-5d4dacbcbbbb tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:05.043271 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-6f359b09-3410-4326-be9f-5d4dacbcbbbb tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:05.257421 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-6f359b09-3410-4326-be9f-5d4dacbcbbbb tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c969fad4feb7468abd62714899d3fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48748543262c417d9089326f428e6b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:34:05.269603 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-6f359b09-3410-4326-be9f-5d4dacbcbbbb tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] 10.222.0.57 "GET /compute/v2.1/servers/3aa9e093-54e1-4388-b035-5f82bab9cd20" status: 200 len: 1314 microversion: 2.1 time: 0.251136 Jun 30 12:34:05.270745 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 80/161] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:34:05 2022] GET /compute/v2.1/servers/3aa9e093-54e1-4388-b035-5f82bab9cd20 => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:34:05.294921 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [req-2cc38fcb-45d2-4b74-a865-ea218b69359a req-3c77ea0b-3aba-41f3-aed9-6150d6ad52bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3aa9e093-54e1-4388-b035-5f82bab9cd20", "tag": "4215e3f4-0228-480f-9d38-67b159455219"}]} {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:34:05.323478 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [req-2cc38fcb-45d2-4b74-a865-ea218b69359a req-3c77ea0b-3aba-41f3-aed9-6150d6ad52bf service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:05.323918 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [req-2cc38fcb-45d2-4b74-a865-ea218b69359a req-3c77ea0b-3aba-41f3-aed9-6150d6ad52bf service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:05.339155 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.compute.server_external_events [req-2cc38fcb-45d2-4b74-a865-ea218b69359a req-3c77ea0b-3aba-41f3-aed9-6150d6ad52bf service nova] Creating event network-changed:4215e3f4-0228-480f-9d38-67b159455219 for instance 3aa9e093-54e1-4388-b035-5f82bab9cd20 on hv-cinder-84614 Jun 30 12:34:05.346665 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [req-2cc38fcb-45d2-4b74-a865-ea218b69359a req-3c77ea0b-3aba-41f3-aed9-6150d6ad52bf service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064478 Jun 30 12:34:05.347997 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 82/162] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 30 12:34:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:34:05.857716 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-eb0f9870-58e4-4692-b498-3b7fb4b45c1d tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:05.858325 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-eb0f9870-58e4-4692-b498-3b7fb4b45c1d tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: a2fe3bb8-40b2-4dea-818a-083e0bc5fb61] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:34:05.864682 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-eb0f9870-58e4-4692-b498-3b7fb4b45c1d tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:05.865172 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-eb0f9870-58e4-4692-b498-3b7fb4b45c1d tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:05.865944 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-eb0f9870-58e4-4692-b498-3b7fb4b45c1d tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:05.866388 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-eb0f9870-58e4-4692-b498-3b7fb4b45c1d tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:06.042633 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-eb0f9870-58e4-4692-b498-3b7fb4b45c1d tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:34:06.054521 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-eb0f9870-58e4-4692-b498-3b7fb4b45c1d tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61" status: 200 len: 1523 microversion: 2.1 time: 0.200051 Jun 30 12:34:06.064879 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 81/163] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:34:05 2022] GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61 => generated 1523 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:34:06.287648 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-61a98687-a6a2-4855-95a5-edeb84c330d1 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:06.288257 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-61a98687-a6a2-4855-95a5-edeb84c330d1 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] [instance: 3aa9e093-54e1-4388-b035-5f82bab9cd20] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:34:06.295560 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-61a98687-a6a2-4855-95a5-edeb84c330d1 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:06.296004 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-61a98687-a6a2-4855-95a5-edeb84c330d1 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:06.297491 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-61a98687-a6a2-4855-95a5-edeb84c330d1 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:06.297996 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-61a98687-a6a2-4855-95a5-edeb84c330d1 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:06.475449 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-61a98687-a6a2-4855-95a5-edeb84c330d1 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c969fad4feb7468abd62714899d3fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48748543262c417d9089326f428e6b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:34:06.484838 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-61a98687-a6a2-4855-95a5-edeb84c330d1 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] 10.222.0.57 "GET /compute/v2.1/servers/3aa9e093-54e1-4388-b035-5f82bab9cd20" status: 200 len: 1314 microversion: 2.1 time: 0.201304 Jun 30 12:34:06.488733 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 83/164] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:34:06 2022] GET /compute/v2.1/servers/3aa9e093-54e1-4388-b035-5f82bab9cd20 => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:34:07.072781 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-61fb6fc5-4a40-45f5-aa7d-0b086bcf3389 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:07.075643 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-61fb6fc5-4a40-45f5-aa7d-0b086bcf3389 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: a2fe3bb8-40b2-4dea-818a-083e0bc5fb61] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:34:07.079312 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG dbcounter [-] [124298] Writing DB stats nova_cell0:SELECT=2 {{(pid=124298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:34:07.083804 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-61fb6fc5-4a40-45f5-aa7d-0b086bcf3389 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:07.084464 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-61fb6fc5-4a40-45f5-aa7d-0b086bcf3389 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:07.085654 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-61fb6fc5-4a40-45f5-aa7d-0b086bcf3389 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:07.086872 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-61fb6fc5-4a40-45f5-aa7d-0b086bcf3389 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:07.316404 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-61fb6fc5-4a40-45f5-aa7d-0b086bcf3389 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:34:07.326513 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-61fb6fc5-4a40-45f5-aa7d-0b086bcf3389 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61" status: 200 len: 1523 microversion: 2.1 time: 0.258860 Jun 30 12:34:07.327739 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 82/165] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:34:07 2022] GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61 => generated 1523 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:34:07.504225 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-ea0675a9-3060-4a79-8125-a718d10026cd tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:07.504881 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-ea0675a9-3060-4a79-8125-a718d10026cd tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] [instance: 3aa9e093-54e1-4388-b035-5f82bab9cd20] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:34:07.517359 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-ea0675a9-3060-4a79-8125-a718d10026cd tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:07.517812 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-ea0675a9-3060-4a79-8125-a718d10026cd tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:07.518589 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-ea0675a9-3060-4a79-8125-a718d10026cd tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:07.521241 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-ea0675a9-3060-4a79-8125-a718d10026cd tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:07.709565 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-ea0675a9-3060-4a79-8125-a718d10026cd tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c969fad4feb7468abd62714899d3fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48748543262c417d9089326f428e6b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:34:07.718737 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-ea0675a9-3060-4a79-8125-a718d10026cd tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] 10.222.0.57 "GET /compute/v2.1/servers/3aa9e093-54e1-4388-b035-5f82bab9cd20" status: 200 len: 1314 microversion: 2.1 time: 0.219882 Jun 30 12:34:07.728508 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 84/166] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:34:07 2022] GET /compute/v2.1/servers/3aa9e093-54e1-4388-b035-5f82bab9cd20 => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:34:08.344425 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-bd3adbff-e861-4cf3-bf61-b9d7a04d8c62 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:08.345073 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-bd3adbff-e861-4cf3-bf61-b9d7a04d8c62 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: a2fe3bb8-40b2-4dea-818a-083e0bc5fb61] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:34:08.352263 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG dbcounter [-] [124298] Writing DB stats nova_cell0:SELECT=8 {{(pid=124298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:34:08.354578 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-bd3adbff-e861-4cf3-bf61-b9d7a04d8c62 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:08.355189 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-bd3adbff-e861-4cf3-bf61-b9d7a04d8c62 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:08.356334 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-bd3adbff-e861-4cf3-bf61-b9d7a04d8c62 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:08.356797 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-bd3adbff-e861-4cf3-bf61-b9d7a04d8c62 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:08.503055 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-bd3adbff-e861-4cf3-bf61-b9d7a04d8c62 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:34:08.511907 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-bd3adbff-e861-4cf3-bf61-b9d7a04d8c62 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61" status: 200 len: 1523 microversion: 2.1 time: 0.172297 Jun 30 12:34:08.512690 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 83/167] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:34:08 2022] GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61 => generated 1523 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:34:08.738027 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-3e9b2ae5-dd81-4e86-b8b5-00015f6a8688 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:08.738635 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-3e9b2ae5-dd81-4e86-b8b5-00015f6a8688 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] [instance: 3aa9e093-54e1-4388-b035-5f82bab9cd20] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:34:08.745362 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-3e9b2ae5-dd81-4e86-b8b5-00015f6a8688 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:08.745809 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-3e9b2ae5-dd81-4e86-b8b5-00015f6a8688 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:08.746605 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-3e9b2ae5-dd81-4e86-b8b5-00015f6a8688 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:08.747034 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-3e9b2ae5-dd81-4e86-b8b5-00015f6a8688 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:08.912418 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-3e9b2ae5-dd81-4e86-b8b5-00015f6a8688 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c969fad4feb7468abd62714899d3fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48748543262c417d9089326f428e6b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:34:08.929628 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-3e9b2ae5-dd81-4e86-b8b5-00015f6a8688 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] 10.222.0.57 "GET /compute/v2.1/servers/3aa9e093-54e1-4388-b035-5f82bab9cd20" status: 200 len: 1314 microversion: 2.1 time: 0.196767 Jun 30 12:34:08.930215 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 85/168] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:34:08 2022] GET /compute/v2.1/servers/3aa9e093-54e1-4388-b035-5f82bab9cd20 => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:34:09.529166 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-788982aa-86d5-4fd4-982b-b297e7d286e0 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:09.530644 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-788982aa-86d5-4fd4-982b-b297e7d286e0 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: a2fe3bb8-40b2-4dea-818a-083e0bc5fb61] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:34:09.538857 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-788982aa-86d5-4fd4-982b-b297e7d286e0 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:09.539554 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-788982aa-86d5-4fd4-982b-b297e7d286e0 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:09.540795 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-788982aa-86d5-4fd4-982b-b297e7d286e0 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:09.541460 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-788982aa-86d5-4fd4-982b-b297e7d286e0 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:09.733269 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-788982aa-86d5-4fd4-982b-b297e7d286e0 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:34:09.741470 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG dbcounter [-] [124298] Writing DB stats nova_cell1:SELECT=100 {{(pid=124298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:34:09.754417 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-788982aa-86d5-4fd4-982b-b297e7d286e0 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61" status: 200 len: 1523 microversion: 2.1 time: 0.229364 Jun 30 12:34:09.755318 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 84/169] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:34:09 2022] GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61 => generated 1523 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:34:09.947539 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-190a623e-368d-4016-8efa-96e9f8285a8c tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:09.948156 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-190a623e-368d-4016-8efa-96e9f8285a8c tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] [instance: 3aa9e093-54e1-4388-b035-5f82bab9cd20] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:34:09.955542 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-190a623e-368d-4016-8efa-96e9f8285a8c tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:09.956045 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-190a623e-368d-4016-8efa-96e9f8285a8c tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:09.957010 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-190a623e-368d-4016-8efa-96e9f8285a8c tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:09.957449 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-190a623e-368d-4016-8efa-96e9f8285a8c tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:10.137354 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-190a623e-368d-4016-8efa-96e9f8285a8c tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c969fad4feb7468abd62714899d3fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48748543262c417d9089326f428e6b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:34:10.147405 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-190a623e-368d-4016-8efa-96e9f8285a8c tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] 10.222.0.57 "GET /compute/v2.1/servers/3aa9e093-54e1-4388-b035-5f82bab9cd20" status: 200 len: 1314 microversion: 2.1 time: 0.203778 Jun 30 12:34:10.148532 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 86/170] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:34:09 2022] GET /compute/v2.1/servers/3aa9e093-54e1-4388-b035-5f82bab9cd20 => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:34:10.777741 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-d885bf37-2f6e-42b1-8286-ccf7a61f6f3f tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:10.779920 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-d885bf37-2f6e-42b1-8286-ccf7a61f6f3f tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: a2fe3bb8-40b2-4dea-818a-083e0bc5fb61] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:34:10.794813 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-d885bf37-2f6e-42b1-8286-ccf7a61f6f3f tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:10.795604 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-d885bf37-2f6e-42b1-8286-ccf7a61f6f3f tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:10.797327 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-d885bf37-2f6e-42b1-8286-ccf7a61f6f3f tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:10.798186 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-d885bf37-2f6e-42b1-8286-ccf7a61f6f3f tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:10.992295 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-d885bf37-2f6e-42b1-8286-ccf7a61f6f3f tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:34:11.000207 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-d885bf37-2f6e-42b1-8286-ccf7a61f6f3f tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61" status: 200 len: 1523 microversion: 2.1 time: 0.232485 Jun 30 12:34:11.002195 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 85/171] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:34:10 2022] GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61 => generated 1523 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:34:11.168167 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-fe6fcb97-2835-43fd-9fde-28df59ee5d31 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:11.169255 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-fe6fcb97-2835-43fd-9fde-28df59ee5d31 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] [instance: 3aa9e093-54e1-4388-b035-5f82bab9cd20] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:34:11.180963 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-fe6fcb97-2835-43fd-9fde-28df59ee5d31 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:11.182414 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-fe6fcb97-2835-43fd-9fde-28df59ee5d31 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:11.183261 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-fe6fcb97-2835-43fd-9fde-28df59ee5d31 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:11.183815 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-fe6fcb97-2835-43fd-9fde-28df59ee5d31 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:11.359829 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-fe6fcb97-2835-43fd-9fde-28df59ee5d31 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c969fad4feb7468abd62714899d3fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48748543262c417d9089326f428e6b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:34:11.367491 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-fe6fcb97-2835-43fd-9fde-28df59ee5d31 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] 10.222.0.57 "GET /compute/v2.1/servers/3aa9e093-54e1-4388-b035-5f82bab9cd20" status: 200 len: 1314 microversion: 2.1 time: 0.205647 Jun 30 12:34:11.368070 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 87/172] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:34:11 2022] GET /compute/v2.1/servers/3aa9e093-54e1-4388-b035-5f82bab9cd20 => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:34:12.017483 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-c05437e1-5f93-4ddb-8806-b72241599c34 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:12.018088 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-c05437e1-5f93-4ddb-8806-b72241599c34 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: a2fe3bb8-40b2-4dea-818a-083e0bc5fb61] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:34:12.024411 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-c05437e1-5f93-4ddb-8806-b72241599c34 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:12.024899 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-c05437e1-5f93-4ddb-8806-b72241599c34 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:12.025653 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-c05437e1-5f93-4ddb-8806-b72241599c34 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:12.026078 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-c05437e1-5f93-4ddb-8806-b72241599c34 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:12.161624 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-c05437e1-5f93-4ddb-8806-b72241599c34 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:34:12.170174 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-c05437e1-5f93-4ddb-8806-b72241599c34 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61" status: 200 len: 1523 microversion: 2.1 time: 0.156334 Jun 30 12:34:12.170747 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 86/173] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:34:12 2022] GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:34:12.384000 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-05c52a1e-4667-461e-a1b7-818a77cb1315 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:12.384601 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-05c52a1e-4667-461e-a1b7-818a77cb1315 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] [instance: 3aa9e093-54e1-4388-b035-5f82bab9cd20] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:34:12.392122 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-05c52a1e-4667-461e-a1b7-818a77cb1315 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:12.392569 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-05c52a1e-4667-461e-a1b7-818a77cb1315 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:12.393372 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-05c52a1e-4667-461e-a1b7-818a77cb1315 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:12.393802 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-05c52a1e-4667-461e-a1b7-818a77cb1315 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:12.532298 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-05c52a1e-4667-461e-a1b7-818a77cb1315 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c969fad4feb7468abd62714899d3fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48748543262c417d9089326f428e6b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:34:12.539709 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-05c52a1e-4667-461e-a1b7-818a77cb1315 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] 10.222.0.57 "GET /compute/v2.1/servers/3aa9e093-54e1-4388-b035-5f82bab9cd20" status: 200 len: 1314 microversion: 2.1 time: 0.159650 Jun 30 12:34:12.540277 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 88/174] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:34:12 2022] GET /compute/v2.1/servers/3aa9e093-54e1-4388-b035-5f82bab9cd20 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:34:13.189072 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-373dc1ec-24eb-486c-a03c-741dc597beda tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:13.190466 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-373dc1ec-24eb-486c-a03c-741dc597beda tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: a2fe3bb8-40b2-4dea-818a-083e0bc5fb61] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:34:13.196875 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-373dc1ec-24eb-486c-a03c-741dc597beda tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:13.197324 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-373dc1ec-24eb-486c-a03c-741dc597beda tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:13.198089 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-373dc1ec-24eb-486c-a03c-741dc597beda tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:13.198521 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-373dc1ec-24eb-486c-a03c-741dc597beda tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:13.340122 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-373dc1ec-24eb-486c-a03c-741dc597beda tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:34:13.351853 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-373dc1ec-24eb-486c-a03c-741dc597beda tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61" status: 200 len: 1523 microversion: 2.1 time: 0.166931 Jun 30 12:34:13.352522 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 87/175] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:34:13 2022] GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61 => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:34:13.557969 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-b4790f4a-5447-4703-ba38-d10d5f0aed40 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:13.558735 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-b4790f4a-5447-4703-ba38-d10d5f0aed40 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] [instance: 3aa9e093-54e1-4388-b035-5f82bab9cd20] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:34:13.565811 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-b4790f4a-5447-4703-ba38-d10d5f0aed40 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:13.566263 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-b4790f4a-5447-4703-ba38-d10d5f0aed40 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:13.567022 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-b4790f4a-5447-4703-ba38-d10d5f0aed40 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:13.567448 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-b4790f4a-5447-4703-ba38-d10d5f0aed40 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:13.702212 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-b4790f4a-5447-4703-ba38-d10d5f0aed40 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c969fad4feb7468abd62714899d3fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48748543262c417d9089326f428e6b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:34:13.713858 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-b4790f4a-5447-4703-ba38-d10d5f0aed40 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] 10.222.0.57 "GET /compute/v2.1/servers/3aa9e093-54e1-4388-b035-5f82bab9cd20" status: 200 len: 1314 microversion: 2.1 time: 0.160546 Jun 30 12:34:13.714710 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 89/176] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:34:13 2022] GET /compute/v2.1/servers/3aa9e093-54e1-4388-b035-5f82bab9cd20 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:34:14.369999 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-255cda0d-a622-4656-9c07-f4c6ed1be4ad tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:14.370612 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-255cda0d-a622-4656-9c07-f4c6ed1be4ad tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: a2fe3bb8-40b2-4dea-818a-083e0bc5fb61] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:34:14.377286 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-255cda0d-a622-4656-9c07-f4c6ed1be4ad tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:14.377673 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-255cda0d-a622-4656-9c07-f4c6ed1be4ad tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:14.378438 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-255cda0d-a622-4656-9c07-f4c6ed1be4ad tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:14.378874 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-255cda0d-a622-4656-9c07-f4c6ed1be4ad tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:14.520062 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-255cda0d-a622-4656-9c07-f4c6ed1be4ad tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:34:14.528414 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-255cda0d-a622-4656-9c07-f4c6ed1be4ad tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61" status: 200 len: 1523 microversion: 2.1 time: 0.162153 Jun 30 12:34:14.529060 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 88/177] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:34:14 2022] GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61 => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:34:14.731765 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-de096f9d-279f-4bc6-ac54-f7ea6b4d0d36 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:14.732410 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-de096f9d-279f-4bc6-ac54-f7ea6b4d0d36 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] [instance: 3aa9e093-54e1-4388-b035-5f82bab9cd20] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:34:14.739559 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-de096f9d-279f-4bc6-ac54-f7ea6b4d0d36 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:14.740013 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-de096f9d-279f-4bc6-ac54-f7ea6b4d0d36 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:14.740821 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-de096f9d-279f-4bc6-ac54-f7ea6b4d0d36 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:14.741309 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-de096f9d-279f-4bc6-ac54-f7ea6b4d0d36 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:14.884804 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-de096f9d-279f-4bc6-ac54-f7ea6b4d0d36 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c969fad4feb7468abd62714899d3fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48748543262c417d9089326f428e6b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:34:14.892974 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-de096f9d-279f-4bc6-ac54-f7ea6b4d0d36 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] 10.222.0.57 "GET /compute/v2.1/servers/3aa9e093-54e1-4388-b035-5f82bab9cd20" status: 200 len: 1314 microversion: 2.1 time: 0.165319 Jun 30 12:34:14.893555 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 90/178] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:34:14 2022] GET /compute/v2.1/servers/3aa9e093-54e1-4388-b035-5f82bab9cd20 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:34:15.141647 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-f7174839-b45f-4c94-bf6a-854061dcb0e4 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:15.142139 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-f7174839-b45f-4c94-bf6a-854061dcb0e4 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] [instance: 13f18862-cd59-44c8-a5c7-08d003e51e26] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:34:15.148596 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-f7174839-b45f-4c94-bf6a-854061dcb0e4 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:15.149160 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-f7174839-b45f-4c94-bf6a-854061dcb0e4 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:15.149963 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-f7174839-b45f-4c94-bf6a-854061dcb0e4 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:15.150398 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-f7174839-b45f-4c94-bf6a-854061dcb0e4 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:15.176490 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-f7174839-b45f-4c94-bf6a-854061dcb0e4 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] [instance: 13f18862-cd59-44c8-a5c7-08d003e51e26] Going to try to terminate instance {{(pid=124298) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 12:34:15.276709 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-f7174839-b45f-4c94-bf6a-854061dcb0e4 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] 10.222.0.57 "DELETE /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26" status: 204 len: 0 microversion: 2.1 time: 0.138697 Jun 30 12:34:15.277477 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 89/179] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 30 12:34:15 2022] DELETE /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 12:34:15.286366 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-ba75e293-03a7-417e-880a-49b359c6070d tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:15.286975 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-ba75e293-03a7-417e-880a-49b359c6070d tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] [instance: 13f18862-cd59-44c8-a5c7-08d003e51e26] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:34:15.293049 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-ba75e293-03a7-417e-880a-49b359c6070d tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:15.293709 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-ba75e293-03a7-417e-880a-49b359c6070d tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:15.294473 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-ba75e293-03a7-417e-880a-49b359c6070d tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:15.294929 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-ba75e293-03a7-417e-880a-49b359c6070d tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:15.428312 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-ba75e293-03a7-417e-880a-49b359c6070d tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b688425466947198520ec7554bb49f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe4f134e4084a878a5e5cf59d96630f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:34:15.436862 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-ba75e293-03a7-417e-880a-49b359c6070d tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] 10.222.0.57 "GET /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26" status: 200 len: 1554 microversion: 2.1 time: 0.154805 Jun 30 12:34:15.437452 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 91/180] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:34:15 2022] GET /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26 => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:34:15.558051 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-429bb102-f7d2-4ae7-9a13-48b262a73552 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:15.559183 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-429bb102-f7d2-4ae7-9a13-48b262a73552 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: a2fe3bb8-40b2-4dea-818a-083e0bc5fb61] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:34:15.571791 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-429bb102-f7d2-4ae7-9a13-48b262a73552 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:15.572532 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-429bb102-f7d2-4ae7-9a13-48b262a73552 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:15.573858 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-429bb102-f7d2-4ae7-9a13-48b262a73552 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:15.574592 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-429bb102-f7d2-4ae7-9a13-48b262a73552 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:15.710542 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-429bb102-f7d2-4ae7-9a13-48b262a73552 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:34:15.718863 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-429bb102-f7d2-4ae7-9a13-48b262a73552 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61" status: 200 len: 1523 microversion: 2.1 time: 0.167987 Jun 30 12:34:15.719438 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 90/181] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:34:15 2022] GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61 => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:34:15.914265 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-1787cd1d-1831-49fd-8e29-c6eb39d20c4d tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:15.915228 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-1787cd1d-1831-49fd-8e29-c6eb39d20c4d tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] [instance: 3aa9e093-54e1-4388-b035-5f82bab9cd20] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:34:15.927425 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-1787cd1d-1831-49fd-8e29-c6eb39d20c4d tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:15.928122 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-1787cd1d-1831-49fd-8e29-c6eb39d20c4d tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:15.929453 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-1787cd1d-1831-49fd-8e29-c6eb39d20c4d tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:15.930175 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-1787cd1d-1831-49fd-8e29-c6eb39d20c4d tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:16.065408 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-1787cd1d-1831-49fd-8e29-c6eb39d20c4d tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c969fad4feb7468abd62714899d3fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48748543262c417d9089326f428e6b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:34:16.073028 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-1787cd1d-1831-49fd-8e29-c6eb39d20c4d tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] 10.222.0.57 "GET /compute/v2.1/servers/3aa9e093-54e1-4388-b035-5f82bab9cd20" status: 200 len: 1314 microversion: 2.1 time: 0.165379 Jun 30 12:34:16.073644 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 92/182] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:34:15 2022] GET /compute/v2.1/servers/3aa9e093-54e1-4388-b035-5f82bab9cd20 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:34:16.454956 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-47d28b74-0ce4-4a3c-bc68-6833e2acf424 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:16.455556 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-47d28b74-0ce4-4a3c-bc68-6833e2acf424 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] [instance: 13f18862-cd59-44c8-a5c7-08d003e51e26] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:34:16.461938 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-47d28b74-0ce4-4a3c-bc68-6833e2acf424 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:16.462381 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-47d28b74-0ce4-4a3c-bc68-6833e2acf424 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:16.463169 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-47d28b74-0ce4-4a3c-bc68-6833e2acf424 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:16.463595 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-47d28b74-0ce4-4a3c-bc68-6833e2acf424 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:16.597182 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-47d28b74-0ce4-4a3c-bc68-6833e2acf424 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b688425466947198520ec7554bb49f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe4f134e4084a878a5e5cf59d96630f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:34:16.610066 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-47d28b74-0ce4-4a3c-bc68-6833e2acf424 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] 10.222.0.57 "GET /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26" status: 200 len: 1554 microversion: 2.1 time: 0.158988 Jun 30 12:34:16.610795 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 91/183] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:34:16 2022] GET /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26 => generated 1554 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:34:16.735744 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-b37a1ff8-b456-4f7c-b775-9e17b4657c4d tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:16.736356 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-b37a1ff8-b456-4f7c-b775-9e17b4657c4d tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: a2fe3bb8-40b2-4dea-818a-083e0bc5fb61] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:34:16.742847 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-b37a1ff8-b456-4f7c-b775-9e17b4657c4d tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:16.743296 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-b37a1ff8-b456-4f7c-b775-9e17b4657c4d tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:16.744062 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-b37a1ff8-b456-4f7c-b775-9e17b4657c4d tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:16.744494 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-b37a1ff8-b456-4f7c-b775-9e17b4657c4d tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:16.884330 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-b37a1ff8-b456-4f7c-b775-9e17b4657c4d tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:34:16.892612 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-b37a1ff8-b456-4f7c-b775-9e17b4657c4d tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61" status: 200 len: 1523 microversion: 2.1 time: 0.160908 Jun 30 12:34:16.893226 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 93/184] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:34:16 2022] GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:34:17.092296 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-c4e732cc-bacc-40ff-9353-66ea1a8229f7 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:17.092856 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-c4e732cc-bacc-40ff-9353-66ea1a8229f7 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] [instance: 3aa9e093-54e1-4388-b035-5f82bab9cd20] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:34:17.099373 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-c4e732cc-bacc-40ff-9353-66ea1a8229f7 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:17.099819 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-c4e732cc-bacc-40ff-9353-66ea1a8229f7 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:17.100589 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-c4e732cc-bacc-40ff-9353-66ea1a8229f7 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:17.101060 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-c4e732cc-bacc-40ff-9353-66ea1a8229f7 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:17.243017 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-c4e732cc-bacc-40ff-9353-66ea1a8229f7 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c969fad4feb7468abd62714899d3fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48748543262c417d9089326f428e6b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:34:17.251166 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-c4e732cc-bacc-40ff-9353-66ea1a8229f7 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] 10.222.0.57 "GET /compute/v2.1/servers/3aa9e093-54e1-4388-b035-5f82bab9cd20" status: 200 len: 1314 microversion: 2.1 time: 0.163559 Jun 30 12:34:17.251742 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 92/185] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:34:17 2022] GET /compute/v2.1/servers/3aa9e093-54e1-4388-b035-5f82bab9cd20 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:34:17.631801 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-5c67d46a-74dc-498d-a5f9-7fed8f52739f tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:17.632364 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-5c67d46a-74dc-498d-a5f9-7fed8f52739f tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] [instance: 13f18862-cd59-44c8-a5c7-08d003e51e26] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:34:17.639126 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-5c67d46a-74dc-498d-a5f9-7fed8f52739f tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:17.639577 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-5c67d46a-74dc-498d-a5f9-7fed8f52739f tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:17.640665 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-5c67d46a-74dc-498d-a5f9-7fed8f52739f tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:17.641105 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-5c67d46a-74dc-498d-a5f9-7fed8f52739f tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:17.783942 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-5c67d46a-74dc-498d-a5f9-7fed8f52739f tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b688425466947198520ec7554bb49f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe4f134e4084a878a5e5cf59d96630f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:34:17.793287 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-5c67d46a-74dc-498d-a5f9-7fed8f52739f tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] 10.222.0.57 "GET /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26" status: 200 len: 1554 microversion: 2.1 time: 0.165234 Jun 30 12:34:17.803456 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 94/186] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:34:17 2022] GET /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26 => generated 1554 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:34:17.863165 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [req-164b76ce-03d7-4872-ad25-fdf9bdf28a96 req-6e9f44e6-dd66-4020-be00-f4767b74ed8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3aa9e093-54e1-4388-b035-5f82bab9cd20", "name": "network-vif-plugged", "status": "completed", "tag": "4215e3f4-0228-480f-9d38-67b159455219"}]} {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:34:17.873058 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [req-164b76ce-03d7-4872-ad25-fdf9bdf28a96 req-6e9f44e6-dd66-4020-be00-f4767b74ed8f service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:17.873660 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [req-164b76ce-03d7-4872-ad25-fdf9bdf28a96 req-6e9f44e6-dd66-4020-be00-f4767b74ed8f service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:17.889088 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.compute.server_external_events [req-164b76ce-03d7-4872-ad25-fdf9bdf28a96 req-6e9f44e6-dd66-4020-be00-f4767b74ed8f service nova] Creating event network-vif-plugged:4215e3f4-0228-480f-9d38-67b159455219 for instance 3aa9e093-54e1-4388-b035-5f82bab9cd20 on hv-cinder-84614 Jun 30 12:34:17.901839 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [req-164b76ce-03d7-4872-ad25-fdf9bdf28a96 req-6e9f44e6-dd66-4020-be00-f4767b74ed8f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042668 Jun 30 12:34:17.902781 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 93/187] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 30 12:34:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:34:17.910017 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-644b0372-fbeb-4268-a2a4-2927cd90e3fe tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:17.910769 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-644b0372-fbeb-4268-a2a4-2927cd90e3fe tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: a2fe3bb8-40b2-4dea-818a-083e0bc5fb61] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:34:17.920668 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-644b0372-fbeb-4268-a2a4-2927cd90e3fe tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:17.921611 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-644b0372-fbeb-4268-a2a4-2927cd90e3fe tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:17.923103 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-644b0372-fbeb-4268-a2a4-2927cd90e3fe tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:17.923805 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-644b0372-fbeb-4268-a2a4-2927cd90e3fe tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:18.069369 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-644b0372-fbeb-4268-a2a4-2927cd90e3fe tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:34:18.077198 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-644b0372-fbeb-4268-a2a4-2927cd90e3fe tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61" status: 200 len: 1523 microversion: 2.1 time: 0.171536 Jun 30 12:34:18.077774 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 95/188] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:34:17 2022] GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61 => generated 1523 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:34:18.271007 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-51090d43-a766-4407-966e-5481b78b96ca tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:18.271704 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-51090d43-a766-4407-966e-5481b78b96ca tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] [instance: 3aa9e093-54e1-4388-b035-5f82bab9cd20] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:34:18.278086 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-51090d43-a766-4407-966e-5481b78b96ca tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:18.278528 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-51090d43-a766-4407-966e-5481b78b96ca tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:18.279280 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-51090d43-a766-4407-966e-5481b78b96ca tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:18.279707 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-51090d43-a766-4407-966e-5481b78b96ca tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:18.427836 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-51090d43-a766-4407-966e-5481b78b96ca tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c969fad4feb7468abd62714899d3fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48748543262c417d9089326f428e6b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:34:18.436005 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-51090d43-a766-4407-966e-5481b78b96ca tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] 10.222.0.57 "GET /compute/v2.1/servers/3aa9e093-54e1-4388-b035-5f82bab9cd20" status: 200 len: 1314 microversion: 2.1 time: 0.169415 Jun 30 12:34:18.436580 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 94/189] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:34:18 2022] GET /compute/v2.1/servers/3aa9e093-54e1-4388-b035-5f82bab9cd20 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:34:18.812065 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-f245f3a0-6488-4e49-91d4-0a4f6cc40b45 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:18.812688 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-f245f3a0-6488-4e49-91d4-0a4f6cc40b45 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] [instance: 13f18862-cd59-44c8-a5c7-08d003e51e26] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:34:18.820026 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-f245f3a0-6488-4e49-91d4-0a4f6cc40b45 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:18.820506 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-f245f3a0-6488-4e49-91d4-0a4f6cc40b45 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:18.821252 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-f245f3a0-6488-4e49-91d4-0a4f6cc40b45 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:18.822132 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-f245f3a0-6488-4e49-91d4-0a4f6cc40b45 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:19.103619 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-855daa9c-9468-4cad-9c93-508ac67d9327 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:19.106718 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-855daa9c-9468-4cad-9c93-508ac67d9327 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: a2fe3bb8-40b2-4dea-818a-083e0bc5fb61] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:34:19.123724 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-855daa9c-9468-4cad-9c93-508ac67d9327 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:19.124699 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-855daa9c-9468-4cad-9c93-508ac67d9327 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:19.126840 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-855daa9c-9468-4cad-9c93-508ac67d9327 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:19.128080 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-855daa9c-9468-4cad-9c93-508ac67d9327 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:19.144611 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-f245f3a0-6488-4e49-91d4-0a4f6cc40b45 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b688425466947198520ec7554bb49f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe4f134e4084a878a5e5cf59d96630f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:34:19.149274 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-f245f3a0-6488-4e49-91d4-0a4f6cc40b45 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] 10.222.0.57 "GET /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26" status: 200 len: 1554 microversion: 2.1 time: 0.340531 Jun 30 12:34:19.149274 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 96/190] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:34:18 2022] GET /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26 => generated 1554 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:34:19.293236 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-855daa9c-9468-4cad-9c93-508ac67d9327 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:34:19.302081 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-855daa9c-9468-4cad-9c93-508ac67d9327 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61" status: 200 len: 1523 microversion: 2.1 time: 0.210644 Jun 30 12:34:19.302651 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 95/191] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:34:19 2022] GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61 => generated 1523 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:34:19.453185 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-ea9169a0-240b-481d-b6e0-5f86dec7a0d8 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:19.453793 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-ea9169a0-240b-481d-b6e0-5f86dec7a0d8 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] [instance: 3aa9e093-54e1-4388-b035-5f82bab9cd20] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:34:19.460044 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-ea9169a0-240b-481d-b6e0-5f86dec7a0d8 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:19.460499 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-ea9169a0-240b-481d-b6e0-5f86dec7a0d8 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:19.461303 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-ea9169a0-240b-481d-b6e0-5f86dec7a0d8 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:19.461735 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-ea9169a0-240b-481d-b6e0-5f86dec7a0d8 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:19.481387 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG dbcounter [-] [124297] Writing DB stats nova_cell1:SELECT=100 {{(pid=124297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:34:19.597231 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-ea9169a0-240b-481d-b6e0-5f86dec7a0d8 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c969fad4feb7468abd62714899d3fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48748543262c417d9089326f428e6b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:34:19.604863 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-ea9169a0-240b-481d-b6e0-5f86dec7a0d8 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] 10.222.0.57 "GET /compute/v2.1/servers/3aa9e093-54e1-4388-b035-5f82bab9cd20" status: 200 len: 1314 microversion: 2.1 time: 0.155571 Jun 30 12:34:19.605433 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 97/192] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:34:19 2022] GET /compute/v2.1/servers/3aa9e093-54e1-4388-b035-5f82bab9cd20 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:34:20.167343 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-94e515df-fbf5-44a6-a586-110ce572a6df tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:20.168788 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-94e515df-fbf5-44a6-a586-110ce572a6df tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] [instance: 13f18862-cd59-44c8-a5c7-08d003e51e26] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:34:20.176579 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-94e515df-fbf5-44a6-a586-110ce572a6df tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:20.177053 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-94e515df-fbf5-44a6-a586-110ce572a6df tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:20.178131 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-94e515df-fbf5-44a6-a586-110ce572a6df tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:20.178732 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-94e515df-fbf5-44a6-a586-110ce572a6df tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:20.321202 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-35a46552-1fb4-42e4-9d46-4faf632da2a2 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:20.321837 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-35a46552-1fb4-42e4-9d46-4faf632da2a2 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: a2fe3bb8-40b2-4dea-818a-083e0bc5fb61] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:34:20.341043 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-35a46552-1fb4-42e4-9d46-4faf632da2a2 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:20.341845 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-35a46552-1fb4-42e4-9d46-4faf632da2a2 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:20.342787 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-35a46552-1fb4-42e4-9d46-4faf632da2a2 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:20.343360 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-35a46552-1fb4-42e4-9d46-4faf632da2a2 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:20.383098 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-94e515df-fbf5-44a6-a586-110ce572a6df tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b688425466947198520ec7554bb49f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe4f134e4084a878a5e5cf59d96630f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:34:20.394172 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-94e515df-fbf5-44a6-a586-110ce572a6df tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] 10.222.0.57 "GET /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26" status: 200 len: 1554 microversion: 2.1 time: 0.231953 Jun 30 12:34:20.395114 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 96/193] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:34:20 2022] GET /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26 => generated 1554 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:34:20.585933 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-35a46552-1fb4-42e4-9d46-4faf632da2a2 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:34:20.596484 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-35a46552-1fb4-42e4-9d46-4faf632da2a2 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61" status: 200 len: 1523 microversion: 2.1 time: 0.280896 Jun 30 12:34:20.607561 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 98/194] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:34:20 2022] GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61 => generated 1523 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 12:34:20.622892 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-657d15f1-96c2-4083-98da-214dc0580bf6 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:20.623953 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-657d15f1-96c2-4083-98da-214dc0580bf6 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] [instance: 3aa9e093-54e1-4388-b035-5f82bab9cd20] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:34:20.632407 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-657d15f1-96c2-4083-98da-214dc0580bf6 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:20.633258 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-657d15f1-96c2-4083-98da-214dc0580bf6 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:20.647481 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-657d15f1-96c2-4083-98da-214dc0580bf6 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:20.647943 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-657d15f1-96c2-4083-98da-214dc0580bf6 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:20.913235 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-657d15f1-96c2-4083-98da-214dc0580bf6 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c969fad4feb7468abd62714899d3fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48748543262c417d9089326f428e6b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:34:20.924208 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-657d15f1-96c2-4083-98da-214dc0580bf6 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] 10.222.0.57 "GET /compute/v2.1/servers/3aa9e093-54e1-4388-b035-5f82bab9cd20" status: 200 len: 1314 microversion: 2.1 time: 0.305188 Jun 30 12:34:20.924928 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 97/195] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:34:20 2022] GET /compute/v2.1/servers/3aa9e093-54e1-4388-b035-5f82bab9cd20 => generated 1314 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:34:21.416555 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-1badfced-b969-4b69-9cef-58462c10f558 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:21.417176 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-1badfced-b969-4b69-9cef-58462c10f558 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] [instance: 13f18862-cd59-44c8-a5c7-08d003e51e26] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:34:21.425684 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG dbcounter [-] [124297] Writing DB stats nova_api:SELECT=64 {{(pid=124297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:34:21.429494 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-1badfced-b969-4b69-9cef-58462c10f558 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:21.430540 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-1badfced-b969-4b69-9cef-58462c10f558 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:21.431593 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-1badfced-b969-4b69-9cef-58462c10f558 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:21.432408 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-1badfced-b969-4b69-9cef-58462c10f558 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:21.573616 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-1badfced-b969-4b69-9cef-58462c10f558 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b688425466947198520ec7554bb49f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe4f134e4084a878a5e5cf59d96630f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:34:21.600331 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-1badfced-b969-4b69-9cef-58462c10f558 tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] 10.222.0.57 "GET /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26" status: 200 len: 1512 microversion: 2.1 time: 0.192268 Jun 30 12:34:21.603604 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 99/196] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:34:21 2022] GET /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26 => generated 1512 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:34:21.612885 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [req-83880efe-3c5c-4a4f-b844-127a855c9e43 req-0e2e0360-de89-431d-bdff-6afc8492c9b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13f18862-cd59-44c8-a5c7-08d003e51e26", "name": "network-vif-deleted", "tag": "a1bc8255-e853-401f-8e86-93ea2467a967"}]} {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:34:21.617436 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-d06597b1-a733-4e42-8992-0dacf11882e4 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:21.618061 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-d06597b1-a733-4e42-8992-0dacf11882e4 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: a2fe3bb8-40b2-4dea-818a-083e0bc5fb61] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:34:21.630616 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [req-83880efe-3c5c-4a4f-b844-127a855c9e43 req-0e2e0360-de89-431d-bdff-6afc8492c9b7 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:21.631057 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [req-83880efe-3c5c-4a4f-b844-127a855c9e43 req-0e2e0360-de89-431d-bdff-6afc8492c9b7 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:21.647240 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-d06597b1-a733-4e42-8992-0dacf11882e4 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:21.647706 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-d06597b1-a733-4e42-8992-0dacf11882e4 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:21.648548 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-d06597b1-a733-4e42-8992-0dacf11882e4 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:21.649013 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-d06597b1-a733-4e42-8992-0dacf11882e4 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:21.653545 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.compute.server_external_events [req-83880efe-3c5c-4a4f-b844-127a855c9e43 req-0e2e0360-de89-431d-bdff-6afc8492c9b7 service nova] Creating event network-vif-deleted:a1bc8255-e853-401f-8e86-93ea2467a967 for instance 13f18862-cd59-44c8-a5c7-08d003e51e26 on hv-cinder-84614 Jun 30 12:34:21.659452 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [req-83880efe-3c5c-4a4f-b844-127a855c9e43 req-0e2e0360-de89-431d-bdff-6afc8492c9b7 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052566 Jun 30 12:34:21.660430 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 98/197] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 30 12:34:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:34:21.840591 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-d06597b1-a733-4e42-8992-0dacf11882e4 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:34:21.848904 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-d06597b1-a733-4e42-8992-0dacf11882e4 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61" status: 200 len: 1523 microversion: 2.1 time: 0.238298 Jun 30 12:34:21.849487 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 100/198] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:34:21 2022] GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61 => generated 1523 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 12:34:21.950996 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-2da2592c-3f85-4220-9136-8c503b0f321a tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:21.952305 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-2da2592c-3f85-4220-9136-8c503b0f321a tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] [instance: 3aa9e093-54e1-4388-b035-5f82bab9cd20] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:34:21.960829 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-2da2592c-3f85-4220-9136-8c503b0f321a tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:21.961563 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-2da2592c-3f85-4220-9136-8c503b0f321a tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:21.962748 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-2da2592c-3f85-4220-9136-8c503b0f321a tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:21.963322 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-2da2592c-3f85-4220-9136-8c503b0f321a tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:22.154768 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-2da2592c-3f85-4220-9136-8c503b0f321a tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c969fad4feb7468abd62714899d3fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48748543262c417d9089326f428e6b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:34:22.164462 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-2da2592c-3f85-4220-9136-8c503b0f321a tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] 10.222.0.57 "GET /compute/v2.1/servers/3aa9e093-54e1-4388-b035-5f82bab9cd20" status: 200 len: 1464 microversion: 2.1 time: 0.226349 Jun 30 12:34:22.165683 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 99/199] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:34:21 2022] GET /compute/v2.1/servers/3aa9e093-54e1-4388-b035-5f82bab9cd20 => generated 1464 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:34:22.232465 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-e3f7ca90-ca20-46cc-ab66-74be186cbc23 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:22.233509 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-e3f7ca90-ca20-46cc-ab66-74be186cbc23 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] [instance: 3aa9e093-54e1-4388-b035-5f82bab9cd20] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:34:22.241857 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-e3f7ca90-ca20-46cc-ab66-74be186cbc23 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:22.241857 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-e3f7ca90-ca20-46cc-ab66-74be186cbc23 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:22.241857 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-e3f7ca90-ca20-46cc-ab66-74be186cbc23 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:22.242133 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-e3f7ca90-ca20-46cc-ab66-74be186cbc23 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:22.272692 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-e3f7ca90-ca20-46cc-ab66-74be186cbc23 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] [instance: 3aa9e093-54e1-4388-b035-5f82bab9cd20] Going to try to terminate instance {{(pid=124297) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 12:34:22.383911 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-e3f7ca90-ca20-46cc-ab66-74be186cbc23 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] 10.222.0.57 "DELETE /compute/v2.1/servers/3aa9e093-54e1-4388-b035-5f82bab9cd20" status: 204 len: 0 microversion: 2.1 time: 0.154717 Jun 30 12:34:22.384609 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 101/200] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 30 12:34:22 2022] DELETE /compute/v2.1/servers/3aa9e093-54e1-4388-b035-5f82bab9cd20 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 12:34:22.394787 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-f8414b9e-b39a-4000-823e-33a377259e10 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:22.395823 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-f8414b9e-b39a-4000-823e-33a377259e10 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] [instance: 3aa9e093-54e1-4388-b035-5f82bab9cd20] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:34:22.419528 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-f8414b9e-b39a-4000-823e-33a377259e10 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:22.421743 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-f8414b9e-b39a-4000-823e-33a377259e10 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:22.422552 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-f8414b9e-b39a-4000-823e-33a377259e10 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:22.423533 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-f8414b9e-b39a-4000-823e-33a377259e10 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:22.575596 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-f8414b9e-b39a-4000-823e-33a377259e10 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c969fad4feb7468abd62714899d3fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48748543262c417d9089326f428e6b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:34:22.583140 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-f8414b9e-b39a-4000-823e-33a377259e10 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] 10.222.0.57 "GET /compute/v2.1/servers/3aa9e093-54e1-4388-b035-5f82bab9cd20" status: 200 len: 1470 microversion: 2.1 time: 0.194069 Jun 30 12:34:22.583713 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 100/201] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:34:22 2022] GET /compute/v2.1/servers/3aa9e093-54e1-4388-b035-5f82bab9cd20 => generated 1470 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:34:22.618721 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-aaa617fa-ca2b-4d48-ac05-563dbae361ed tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:22.619844 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-aaa617fa-ca2b-4d48-ac05-563dbae361ed tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] [instance: 13f18862-cd59-44c8-a5c7-08d003e51e26] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:34:22.626685 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-aaa617fa-ca2b-4d48-ac05-563dbae361ed tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:22.627350 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-aaa617fa-ca2b-4d48-ac05-563dbae361ed tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:22.628116 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-aaa617fa-ca2b-4d48-ac05-563dbae361ed tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:22.628546 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-aaa617fa-ca2b-4d48-ac05-563dbae361ed tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:22.662063 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-aaa617fa-ca2b-4d48-ac05-563dbae361ed tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:22.662502 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-aaa617fa-ca2b-4d48-ac05-563dbae361ed tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:22.662941 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.objects.instance [None req-aaa617fa-ca2b-4d48-ac05-563dbae361ed tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lazy-loading 'fault' on Instance uuid 13f18862-cd59-44c8-a5c7-08d003e51e26 {{(pid=124297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 12:34:22.709332 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-aaa617fa-ca2b-4d48-ac05-563dbae361ed tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b688425466947198520ec7554bb49f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe4f134e4084a878a5e5cf59d96630f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:34:22.717644 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-aaa617fa-ca2b-4d48-ac05-563dbae361ed tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] 10.222.0.57 "GET /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26" status: 200 len: 1351 microversion: 2.1 time: 0.103509 Jun 30 12:34:22.718225 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 102/202] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:34:22 2022] GET /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26 => generated 1351 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:34:22.866093 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-85b4cbba-eac4-449d-ac10-056a04f9d0e3 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:22.866662 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-85b4cbba-eac4-449d-ac10-056a04f9d0e3 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: a2fe3bb8-40b2-4dea-818a-083e0bc5fb61] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:34:22.872830 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-85b4cbba-eac4-449d-ac10-056a04f9d0e3 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:22.873272 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-85b4cbba-eac4-449d-ac10-056a04f9d0e3 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:22.874030 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-85b4cbba-eac4-449d-ac10-056a04f9d0e3 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:22.874461 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-85b4cbba-eac4-449d-ac10-056a04f9d0e3 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:22.878542 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG dbcounter [-] [124298] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:34:23.014025 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-85b4cbba-eac4-449d-ac10-056a04f9d0e3 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:34:23.022390 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-85b4cbba-eac4-449d-ac10-056a04f9d0e3 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61" status: 200 len: 1523 microversion: 2.1 time: 0.160156 Jun 30 12:34:23.023185 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 101/203] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:34:22 2022] GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:34:23.601782 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-ce2abd21-3393-4c14-9f54-d7b738b622c6 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:23.602389 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-ce2abd21-3393-4c14-9f54-d7b738b622c6 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] [instance: 3aa9e093-54e1-4388-b035-5f82bab9cd20] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:34:23.608967 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-ce2abd21-3393-4c14-9f54-d7b738b622c6 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:23.609413 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-ce2abd21-3393-4c14-9f54-d7b738b622c6 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:23.610338 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-ce2abd21-3393-4c14-9f54-d7b738b622c6 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:23.611141 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-ce2abd21-3393-4c14-9f54-d7b738b622c6 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:23.738917 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-7e963738-a74d-496f-915e-94a20ee2635f tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:23.739540 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-7e963738-a74d-496f-915e-94a20ee2635f tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] [instance: 13f18862-cd59-44c8-a5c7-08d003e51e26] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:34:23.756564 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-7e963738-a74d-496f-915e-94a20ee2635f tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:23.756564 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-7e963738-a74d-496f-915e-94a20ee2635f tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:23.756564 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-7e963738-a74d-496f-915e-94a20ee2635f tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:23.756564 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-7e963738-a74d-496f-915e-94a20ee2635f tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:23.791554 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-ce2abd21-3393-4c14-9f54-d7b738b622c6 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c969fad4feb7468abd62714899d3fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48748543262c417d9089326f428e6b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:34:23.800124 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-ce2abd21-3393-4c14-9f54-d7b738b622c6 tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] 10.222.0.57 "GET /compute/v2.1/servers/3aa9e093-54e1-4388-b035-5f82bab9cd20" status: 200 len: 1470 microversion: 2.1 time: 0.203134 Jun 30 12:34:23.800723 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 103/204] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:34:23 2022] GET /compute/v2.1/servers/3aa9e093-54e1-4388-b035-5f82bab9cd20 => generated 1470 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:34:23.806821 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-7e963738-a74d-496f-915e-94a20ee2635f tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:23.807279 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-7e963738-a74d-496f-915e-94a20ee2635f tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:23.807748 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.objects.instance [None req-7e963738-a74d-496f-915e-94a20ee2635f tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lazy-loading 'fault' on Instance uuid 13f18862-cd59-44c8-a5c7-08d003e51e26 {{(pid=124298) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 12:34:23.855528 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-7e963738-a74d-496f-915e-94a20ee2635f tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b688425466947198520ec7554bb49f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe4f134e4084a878a5e5cf59d96630f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:34:23.864470 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-7e963738-a74d-496f-915e-94a20ee2635f tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] 10.222.0.57 "GET /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26" status: 200 len: 1351 microversion: 2.1 time: 0.131897 Jun 30 12:34:23.865085 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 102/205] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:34:23 2022] GET /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26 => generated 1351 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 12:34:24.039884 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-5f73a01b-3406-4284-aabe-e7d6fcf63f4f tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:24.040604 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-5f73a01b-3406-4284-aabe-e7d6fcf63f4f tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: a2fe3bb8-40b2-4dea-818a-083e0bc5fb61] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:34:24.049439 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-5f73a01b-3406-4284-aabe-e7d6fcf63f4f tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:24.050002 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-5f73a01b-3406-4284-aabe-e7d6fcf63f4f tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:24.050814 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-5f73a01b-3406-4284-aabe-e7d6fcf63f4f tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:24.051547 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-5f73a01b-3406-4284-aabe-e7d6fcf63f4f tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:24.203826 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-5f73a01b-3406-4284-aabe-e7d6fcf63f4f tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:34:24.212496 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-5f73a01b-3406-4284-aabe-e7d6fcf63f4f tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61" status: 200 len: 1523 microversion: 2.1 time: 0.177330 Jun 30 12:34:24.213126 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 104/206] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:34:24 2022] GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61 => generated 1523 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:34:24.820031 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-12d9b047-f4a8-47d6-b102-b05519ff41fb tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:24.821059 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-12d9b047-f4a8-47d6-b102-b05519ff41fb tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] [instance: 3aa9e093-54e1-4388-b035-5f82bab9cd20] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:34:24.833612 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-12d9b047-f4a8-47d6-b102-b05519ff41fb tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:24.834183 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-12d9b047-f4a8-47d6-b102-b05519ff41fb tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:24.836950 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-12d9b047-f4a8-47d6-b102-b05519ff41fb tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:24.838232 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-12d9b047-f4a8-47d6-b102-b05519ff41fb tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:24.881850 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-0a2e52d4-0548-46ea-976a-88e3a49b035c tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:24.882629 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-0a2e52d4-0548-46ea-976a-88e3a49b035c tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] [instance: 13f18862-cd59-44c8-a5c7-08d003e51e26] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:34:24.906211 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-0a2e52d4-0548-46ea-976a-88e3a49b035c tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:24.911833 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-0a2e52d4-0548-46ea-976a-88e3a49b035c tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:24.912735 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-0a2e52d4-0548-46ea-976a-88e3a49b035c tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:24.913186 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-0a2e52d4-0548-46ea-976a-88e3a49b035c tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:24.968266 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.wsgi [None req-0a2e52d4-0548-46ea-976a-88e3a49b035c tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] HTTP exception thrown: Instance 13f18862-cd59-44c8-a5c7-08d003e51e26 could not be found. Jun 30 12:34:24.976504 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-0a2e52d4-0548-46ea-976a-88e3a49b035c tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Request method failure captured: Jun 30 12:34:24.976504 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: request: GET /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26 HTTP/1.1 Jun 30 12:34:24.976504 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Accept: application/json Jun 30 12:34:24.976504 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Accept-Encoding: identity Jun 30 12:34:24.976504 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Connection: close Jun 30 12:34:24.976504 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Content-Length: 0 Jun 30 12:34:24.976504 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Content-Type: application/json Jun 30 12:34:24.976504 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Host: 10.222.0.57 Jun 30 12:34:24.976504 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Openstack-System-Scope: None Jun 30 12:34:24.976504 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: User-Agent: python-urllib3/1.26.9 Jun 30 12:34:24.976504 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Auth-Token: gAAAAABivZf8Z3y3PUxpTtIeWtt7kreEFLDF7vk9sK-5Bu7AV6gil2Tej37tsCJYE0TrsFUbTxMFwZoI-h5AZmFPGg9sVzJ8nHIidFKQtxqT8y2_t2B5kLRy9w9r11Rz0tf9Jsjh05JKYZLlT7Sp33kWVqpfV9JpexESitN0A6bWa6J17Wrn4W0 Jun 30 12:34:24.976504 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Domain-Id: None Jun 30 12:34:24.976504 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Domain-Name: None Jun 30 12:34:24.976504 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Identity-Status: Confirmed Jun 30 12:34:24.976504 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Is-Admin-Project: True Jun 30 12:34:24.976504 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Project-Domain-Id: default Jun 30 12:34:24.976504 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Project-Domain-Name: Default Jun 30 12:34:24.976504 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Project-Id: 8fe4f134e4084a878a5e5cf59d96630f Jun 30 12:34:24.976504 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Project-Name: tempest-DeleteServersTestJSON-1034005234 Jun 30 12:34:24.976504 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Role: member,reader Jun 30 12:34:24.976504 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Roles: member,reader Jun 30 12:34:24.979995 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/8fe4f134e4084a878a5e5cf59d96630f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8fe4f134e4084a878a5e5cf59d96630f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_8fe4f134e4084a878a5e5cf59d96630f", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8fe4f134e4084a878a5e5cf59d96630f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 30 12:34:24.979995 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Tenant: tempest-DeleteServersTestJSON-1034005234 Jun 30 12:34:24.979995 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Tenant-Id: 8fe4f134e4084a878a5e5cf59d96630f Jun 30 12:34:24.979995 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Tenant-Name: tempest-DeleteServersTestJSON-1034005234 Jun 30 12:34:24.979995 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User: tempest-DeleteServersTestJSON-1034005234-project Jun 30 12:34:24.979995 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User-Domain-Id: default Jun 30 12:34:24.979995 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User-Domain-Name: Default Jun 30 12:34:24.979995 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User-Id: 3b688425466947198520ec7554bb49f7 Jun 30 12:34:24.979995 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User-Name: tempest-DeleteServersTestJSON-1034005234-project Jun 30 12:34:24.979995 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: method: > Jun 30 12:34:24.979995 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: exception: Instance 13f18862-cd59-44c8-a5c7-08d003e51e26 could not be found. Jun 30 12:34:24.979995 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: action_args: {'id': '13f18862-cd59-44c8-a5c7-08d003e51e26'} Jun 30 12:34:24.980979 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 12:34:24.980979 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:34:24.980979 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 12:34:24.980979 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 12:34:24.980979 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 12:34:24.980979 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 12:34:24.980979 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 12:34:24.980979 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 12:34:24.980979 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 12:34:24.980979 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 12:34:24.980979 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13f18862-cd59-44c8-a5c7-08d003e51e26 could not be found. Jun 30 12:34:24.980979 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:34:24.980979 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:34:24.980979 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:34:24.980979 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:34:24.980979 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:34:24.980979 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:34:24.980979 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 12:34:24.980979 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 12:34:24.980979 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 12:34:24.982534 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 12:34:24.982534 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 12:34:24.982534 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 12:34:24.982534 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 12:34:24.982534 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 12:34:24.982534 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 12:34:24.982534 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 12:34:24.982534 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13f18862-cd59-44c8-a5c7-08d003e51e26 could not be found. Jun 30 12:34:24.982534 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:34:24.982534 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:34:24.982534 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:34:24.982534 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:34:24.982534 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:34:24.982534 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:34:24.982534 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 12:34:24.982534 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 12:34:24.982534 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13f18862-cd59-44c8-a5c7-08d003e51e26 could not be found. Jun 30 12:34:24.982534 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:34:24.983928 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-0a2e52d4-0548-46ea-976a-88e3a49b035c tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Returning 404 to user: Instance 13f18862-cd59-44c8-a5c7-08d003e51e26 could not be found. {{(pid=124297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 12:34:24.984489 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-12d9b047-f4a8-47d6-b102-b05519ff41fb tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c969fad4feb7468abd62714899d3fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48748543262c417d9089326f428e6b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:34:24.984582 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-0a2e52d4-0548-46ea-976a-88e3a49b035c tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] 10.222.0.57 "GET /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26" status: 404 len: 111 microversion: 2.1 time: 0.101399 Jun 30 12:34:24.988192 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 105/207] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:34:24 2022] GET /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 30 12:34:24.992228 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-12d9b047-f4a8-47d6-b102-b05519ff41fb tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] 10.222.0.57 "GET /compute/v2.1/servers/3aa9e093-54e1-4388-b035-5f82bab9cd20" status: 200 len: 1428 microversion: 2.1 time: 0.177560 Jun 30 12:34:25.000146 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 103/208] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:34:24 2022] GET /compute/v2.1/servers/3aa9e093-54e1-4388-b035-5f82bab9cd20 => generated 1428 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:34:25.071564 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [req-f2b8a04b-16c9-42ab-9c99-82c56393753e req-15014ef8-40b2-4e92-9ccb-bb1a67fc584a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3aa9e093-54e1-4388-b035-5f82bab9cd20", "name": "network-vif-deleted", "tag": "4215e3f4-0228-480f-9d38-67b159455219"}]} {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:34:25.083943 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [req-f2b8a04b-16c9-42ab-9c99-82c56393753e req-15014ef8-40b2-4e92-9ccb-bb1a67fc584a service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:25.084989 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [req-f2b8a04b-16c9-42ab-9c99-82c56393753e req-15014ef8-40b2-4e92-9ccb-bb1a67fc584a service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:25.113116 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.compute.server_external_events [req-f2b8a04b-16c9-42ab-9c99-82c56393753e req-15014ef8-40b2-4e92-9ccb-bb1a67fc584a service nova] Creating event network-vif-deleted:4215e3f4-0228-480f-9d38-67b159455219 for instance 3aa9e093-54e1-4388-b035-5f82bab9cd20 on hv-cinder-84614 Jun 30 12:34:25.119279 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [req-f2b8a04b-16c9-42ab-9c99-82c56393753e req-15014ef8-40b2-4e92-9ccb-bb1a67fc584a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058348 Jun 30 12:34:25.120902 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 106/209] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 30 12:34:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:34:25.135506 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-a150af48-ba05-4635-b934-8b7cc135c80b tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:25.136608 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-a150af48-ba05-4635-b934-8b7cc135c80b tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] [instance: 13f18862-cd59-44c8-a5c7-08d003e51e26] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:34:25.145677 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-a150af48-ba05-4635-b934-8b7cc135c80b tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:25.146130 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-a150af48-ba05-4635-b934-8b7cc135c80b tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:25.146910 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-a150af48-ba05-4635-b934-8b7cc135c80b tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:25.153021 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-a150af48-ba05-4635-b934-8b7cc135c80b tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:25.195715 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.wsgi [None req-a150af48-ba05-4635-b934-8b7cc135c80b tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] HTTP exception thrown: Instance 13f18862-cd59-44c8-a5c7-08d003e51e26 could not be found. Jun 30 12:34:25.201124 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-a150af48-ba05-4635-b934-8b7cc135c80b tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Request method failure captured: Jun 30 12:34:25.201124 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: request: GET /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26/os-volume_attachments HTTP/1.1 Jun 30 12:34:25.201124 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Accept: application/json Jun 30 12:34:25.201124 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Accept-Encoding: identity Jun 30 12:34:25.201124 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Connection: close Jun 30 12:34:25.201124 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Content-Length: 0 Jun 30 12:34:25.201124 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Content-Type: application/json Jun 30 12:34:25.201124 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Host: 10.222.0.57 Jun 30 12:34:25.201124 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Openstack-System-Scope: None Jun 30 12:34:25.201124 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: User-Agent: python-urllib3/1.26.9 Jun 30 12:34:25.201124 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Auth-Token: gAAAAABivZf8Z3y3PUxpTtIeWtt7kreEFLDF7vk9sK-5Bu7AV6gil2Tej37tsCJYE0TrsFUbTxMFwZoI-h5AZmFPGg9sVzJ8nHIidFKQtxqT8y2_t2B5kLRy9w9r11Rz0tf9Jsjh05JKYZLlT7Sp33kWVqpfV9JpexESitN0A6bWa6J17Wrn4W0 Jun 30 12:34:25.201124 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Domain-Id: None Jun 30 12:34:25.201124 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Domain-Name: None Jun 30 12:34:25.201124 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Identity-Status: Confirmed Jun 30 12:34:25.201124 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Is-Admin-Project: True Jun 30 12:34:25.201124 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Domain-Id: default Jun 30 12:34:25.201124 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Domain-Name: Default Jun 30 12:34:25.201124 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Id: 8fe4f134e4084a878a5e5cf59d96630f Jun 30 12:34:25.201124 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Name: tempest-DeleteServersTestJSON-1034005234 Jun 30 12:34:25.201124 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Role: member,reader Jun 30 12:34:25.201124 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Roles: member,reader Jun 30 12:34:25.202523 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/8fe4f134e4084a878a5e5cf59d96630f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8fe4f134e4084a878a5e5cf59d96630f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_8fe4f134e4084a878a5e5cf59d96630f", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8fe4f134e4084a878a5e5cf59d96630f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 30 12:34:25.202523 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant: tempest-DeleteServersTestJSON-1034005234 Jun 30 12:34:25.202523 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant-Id: 8fe4f134e4084a878a5e5cf59d96630f Jun 30 12:34:25.202523 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant-Name: tempest-DeleteServersTestJSON-1034005234 Jun 30 12:34:25.202523 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User: tempest-DeleteServersTestJSON-1034005234-project Jun 30 12:34:25.202523 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Domain-Id: default Jun 30 12:34:25.202523 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Domain-Name: Default Jun 30 12:34:25.202523 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Id: 3b688425466947198520ec7554bb49f7 Jun 30 12:34:25.202523 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Name: tempest-DeleteServersTestJSON-1034005234-project Jun 30 12:34:25.202523 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: method: > Jun 30 12:34:25.202523 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: exception: Instance 13f18862-cd59-44c8-a5c7-08d003e51e26 could not be found. Jun 30 12:34:25.202523 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: action_args: {'server_id': '13f18862-cd59-44c8-a5c7-08d003e51e26'} Jun 30 12:34:25.203364 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 12:34:25.203364 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:34:25.203364 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 12:34:25.203364 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 12:34:25.203364 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 12:34:25.203364 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 12:34:25.203364 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 12:34:25.203364 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 12:34:25.203364 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 12:34:25.203364 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 12:34:25.203364 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13f18862-cd59-44c8-a5c7-08d003e51e26 could not be found. Jun 30 12:34:25.203364 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:34:25.203364 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:34:25.203364 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:34:25.203364 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:34:25.203364 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:34:25.203364 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:34:25.203364 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 12:34:25.203364 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 12:34:25.203364 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 12:34:25.204987 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 12:34:25.204987 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 30 12:34:25.204987 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 30 12:34:25.204987 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 30 12:34:25.204987 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 30 12:34:25.204987 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 30 12:34:25.204987 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 30 12:34:25.204987 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 12:34:25.204987 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 12:34:25.204987 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13f18862-cd59-44c8-a5c7-08d003e51e26 could not be found. Jun 30 12:34:25.204987 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:34:25.204987 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:34:25.204987 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:34:25.204987 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:34:25.204987 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:34:25.204987 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:34:25.204987 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 12:34:25.204987 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 12:34:25.204987 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13f18862-cd59-44c8-a5c7-08d003e51e26 could not be found. Jun 30 12:34:25.204987 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:34:25.206352 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-a150af48-ba05-4635-b934-8b7cc135c80b tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Returning 404 to user: Instance 13f18862-cd59-44c8-a5c7-08d003e51e26 could not be found. {{(pid=124298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 12:34:25.207461 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-a150af48-ba05-4635-b934-8b7cc135c80b tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] 10.222.0.57 "GET /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.075802 Jun 30 12:34:25.225729 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 104/210] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jun 30 12:34:25 2022] GET /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26/os-volume_attachments => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 12:34:25.238041 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-e622db66-ec78-4f71-a242-d8c0f03054cb tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:25.239557 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-e622db66-ec78-4f71-a242-d8c0f03054cb tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: a2fe3bb8-40b2-4dea-818a-083e0bc5fb61] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:34:25.247082 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-e622db66-ec78-4f71-a242-d8c0f03054cb tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:25.247786 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-e622db66-ec78-4f71-a242-d8c0f03054cb tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:25.248751 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-e622db66-ec78-4f71-a242-d8c0f03054cb tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:25.250474 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-e622db66-ec78-4f71-a242-d8c0f03054cb tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:25.429160 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-e622db66-ec78-4f71-a242-d8c0f03054cb tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:34:25.440754 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-e622db66-ec78-4f71-a242-d8c0f03054cb tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61" status: 200 len: 1523 microversion: 2.1 time: 0.212153 Jun 30 12:34:25.440754 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 107/211] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:34:25 2022] GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61 => generated 1523 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:34:26.010869 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-c2ffb5b4-b4d0-4801-b594-caa9d0d502cb tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:26.011588 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-c2ffb5b4-b4d0-4801-b594-caa9d0d502cb tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] [instance: 3aa9e093-54e1-4388-b035-5f82bab9cd20] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:34:26.023240 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-c2ffb5b4-b4d0-4801-b594-caa9d0d502cb tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:26.024187 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-c2ffb5b4-b4d0-4801-b594-caa9d0d502cb tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:26.025306 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-c2ffb5b4-b4d0-4801-b594-caa9d0d502cb tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:26.025784 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-c2ffb5b4-b4d0-4801-b594-caa9d0d502cb tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:26.044550 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.wsgi [None req-c2ffb5b4-b4d0-4801-b594-caa9d0d502cb tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] HTTP exception thrown: Instance 3aa9e093-54e1-4388-b035-5f82bab9cd20 could not be found. Jun 30 12:34:26.048268 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-c2ffb5b4-b4d0-4801-b594-caa9d0d502cb tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Request method failure captured: Jun 30 12:34:26.048268 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: request: GET /compute/v2.1/servers/3aa9e093-54e1-4388-b035-5f82bab9cd20 HTTP/1.1 Jun 30 12:34:26.048268 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Accept: application/json Jun 30 12:34:26.048268 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Accept-Encoding: identity Jun 30 12:34:26.048268 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Connection: close Jun 30 12:34:26.048268 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Content-Length: 0 Jun 30 12:34:26.048268 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Content-Type: application/json Jun 30 12:34:26.048268 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Host: 10.222.0.57 Jun 30 12:34:26.048268 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Openstack-System-Scope: None Jun 30 12:34:26.048268 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: User-Agent: python-urllib3/1.26.9 Jun 30 12:34:26.048268 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Auth-Token: gAAAAABivZgxNIBUbZSB9hN1MAuWY71da9tTkVTifp3AiEpMtN_jmyJdTtbvJ6EIRJN4P2jb2nTeXIqHbMPfwf8PvSDHXSQPL4pJ-g-tMRCZCxVFJWjWrPvab3o8GBFDtMZPhkwUacokE5wJ0TTlJ52-B8mAF9iGbr3ghoQ9_St-ElQucpOZmBE Jun 30 12:34:26.048268 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Domain-Id: None Jun 30 12:34:26.048268 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Domain-Name: None Jun 30 12:34:26.048268 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Identity-Status: Confirmed Jun 30 12:34:26.048268 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Is-Admin-Project: True Jun 30 12:34:26.048268 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Domain-Id: default Jun 30 12:34:26.048268 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Domain-Name: Default Jun 30 12:34:26.048268 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Id: 48748543262c417d9089326f428e6b63 Jun 30 12:34:26.048268 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Name: tempest-VolumesNegativeTest-1288848960 Jun 30 12:34:26.048268 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Role: member,reader Jun 30 12:34:26.048268 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Roles: member,reader Jun 30 12:34:26.049861 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/48748543262c417d9089326f428e6b63"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/48748543262c417d9089326f428e6b63"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_48748543262c417d9089326f428e6b63", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/48748543262c417d9089326f428e6b63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 30 12:34:26.049861 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant: tempest-VolumesNegativeTest-1288848960 Jun 30 12:34:26.049861 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant-Id: 48748543262c417d9089326f428e6b63 Jun 30 12:34:26.049861 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant-Name: tempest-VolumesNegativeTest-1288848960 Jun 30 12:34:26.049861 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User: tempest-VolumesNegativeTest-1288848960-project Jun 30 12:34:26.049861 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Domain-Id: default Jun 30 12:34:26.049861 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Domain-Name: Default Jun 30 12:34:26.049861 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Id: c969fad4feb7468abd62714899d3fc2b Jun 30 12:34:26.049861 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Name: tempest-VolumesNegativeTest-1288848960-project Jun 30 12:34:26.049861 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: method: > Jun 30 12:34:26.049861 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: exception: Instance 3aa9e093-54e1-4388-b035-5f82bab9cd20 could not be found. Jun 30 12:34:26.049861 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: action_args: {'id': '3aa9e093-54e1-4388-b035-5f82bab9cd20'} Jun 30 12:34:26.050679 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 12:34:26.050679 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:34:26.050679 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 12:34:26.050679 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 12:34:26.050679 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 12:34:26.050679 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 12:34:26.050679 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 12:34:26.050679 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 12:34:26.050679 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 12:34:26.050679 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 12:34:26.050679 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3aa9e093-54e1-4388-b035-5f82bab9cd20 could not be found. Jun 30 12:34:26.050679 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:34:26.050679 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:34:26.050679 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:34:26.050679 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:34:26.050679 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:34:26.050679 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:34:26.050679 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 12:34:26.050679 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 12:34:26.050679 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 12:34:26.051966 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 12:34:26.051966 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 12:34:26.051966 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 12:34:26.051966 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 12:34:26.051966 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 12:34:26.051966 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 12:34:26.051966 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 12:34:26.051966 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3aa9e093-54e1-4388-b035-5f82bab9cd20 could not be found. Jun 30 12:34:26.051966 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:34:26.051966 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:34:26.051966 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:34:26.051966 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:34:26.051966 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:34:26.051966 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:34:26.051966 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 12:34:26.051966 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 12:34:26.051966 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3aa9e093-54e1-4388-b035-5f82bab9cd20 could not be found. Jun 30 12:34:26.051966 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:34:26.053379 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-c2ffb5b4-b4d0-4801-b594-caa9d0d502cb tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] Returning 404 to user: Instance 3aa9e093-54e1-4388-b035-5f82bab9cd20 could not be found. {{(pid=124298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 12:34:26.053379 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-c2ffb5b4-b4d0-4801-b594-caa9d0d502cb tempest-VolumesNegativeTest-1288848960 tempest-VolumesNegativeTest-1288848960-project] 10.222.0.57 "GET /compute/v2.1/servers/3aa9e093-54e1-4388-b035-5f82bab9cd20" status: 404 len: 111 microversion: 2.1 time: 0.043824 Jun 30 12:34:26.053379 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 105/212] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:34:26 2022] GET /compute/v2.1/servers/3aa9e093-54e1-4388-b035-5f82bab9cd20 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 12:34:26.457107 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-05bba7ea-5151-4aec-b039-aabf7897fe19 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:26.457910 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-05bba7ea-5151-4aec-b039-aabf7897fe19 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: a2fe3bb8-40b2-4dea-818a-083e0bc5fb61] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:34:26.465210 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-05bba7ea-5151-4aec-b039-aabf7897fe19 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:26.465678 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-05bba7ea-5151-4aec-b039-aabf7897fe19 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:26.466550 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-05bba7ea-5151-4aec-b039-aabf7897fe19 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:26.467018 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-05bba7ea-5151-4aec-b039-aabf7897fe19 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:26.497737 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-92418a61-53ac-458c-857d-ef4dbed90e6c tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:26.499168 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-92418a61-53ac-458c-857d-ef4dbed90e6c tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] [instance: 13f18862-cd59-44c8-a5c7-08d003e51e26] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:34:26.509580 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-92418a61-53ac-458c-857d-ef4dbed90e6c tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:26.510168 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-92418a61-53ac-458c-857d-ef4dbed90e6c tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:26.511417 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-92418a61-53ac-458c-857d-ef4dbed90e6c tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:26.512066 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-92418a61-53ac-458c-857d-ef4dbed90e6c tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:26.528141 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.wsgi [None req-92418a61-53ac-458c-857d-ef4dbed90e6c tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] HTTP exception thrown: Instance 13f18862-cd59-44c8-a5c7-08d003e51e26 could not be found. Jun 30 12:34:26.529980 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-92418a61-53ac-458c-857d-ef4dbed90e6c tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Request method failure captured: Jun 30 12:34:26.529980 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: request: DELETE /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26 HTTP/1.1 Jun 30 12:34:26.529980 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Accept: application/json Jun 30 12:34:26.529980 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Accept-Encoding: identity Jun 30 12:34:26.529980 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Connection: close Jun 30 12:34:26.529980 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Content-Length: 0 Jun 30 12:34:26.529980 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Content-Type: application/json Jun 30 12:34:26.529980 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Host: 10.222.0.57 Jun 30 12:34:26.529980 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Openstack-System-Scope: None Jun 30 12:34:26.529980 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: User-Agent: python-urllib3/1.26.9 Jun 30 12:34:26.529980 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Auth-Token: gAAAAABivZf8Z3y3PUxpTtIeWtt7kreEFLDF7vk9sK-5Bu7AV6gil2Tej37tsCJYE0TrsFUbTxMFwZoI-h5AZmFPGg9sVzJ8nHIidFKQtxqT8y2_t2B5kLRy9w9r11Rz0tf9Jsjh05JKYZLlT7Sp33kWVqpfV9JpexESitN0A6bWa6J17Wrn4W0 Jun 30 12:34:26.529980 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Domain-Id: None Jun 30 12:34:26.529980 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Domain-Name: None Jun 30 12:34:26.529980 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Identity-Status: Confirmed Jun 30 12:34:26.529980 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Is-Admin-Project: True Jun 30 12:34:26.529980 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Domain-Id: default Jun 30 12:34:26.529980 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Domain-Name: Default Jun 30 12:34:26.529980 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Id: 8fe4f134e4084a878a5e5cf59d96630f Jun 30 12:34:26.529980 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Name: tempest-DeleteServersTestJSON-1034005234 Jun 30 12:34:26.529980 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Role: member,reader Jun 30 12:34:26.529980 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Roles: member,reader Jun 30 12:34:26.531520 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/8fe4f134e4084a878a5e5cf59d96630f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8fe4f134e4084a878a5e5cf59d96630f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_8fe4f134e4084a878a5e5cf59d96630f", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8fe4f134e4084a878a5e5cf59d96630f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 30 12:34:26.531520 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant: tempest-DeleteServersTestJSON-1034005234 Jun 30 12:34:26.531520 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant-Id: 8fe4f134e4084a878a5e5cf59d96630f Jun 30 12:34:26.531520 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant-Name: tempest-DeleteServersTestJSON-1034005234 Jun 30 12:34:26.531520 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User: tempest-DeleteServersTestJSON-1034005234-project Jun 30 12:34:26.531520 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Domain-Id: default Jun 30 12:34:26.531520 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Domain-Name: Default Jun 30 12:34:26.531520 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Id: 3b688425466947198520ec7554bb49f7 Jun 30 12:34:26.531520 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Name: tempest-DeleteServersTestJSON-1034005234-project Jun 30 12:34:26.531520 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: method: > Jun 30 12:34:26.531520 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: exception: Instance 13f18862-cd59-44c8-a5c7-08d003e51e26 could not be found. Jun 30 12:34:26.531520 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: action_args: {'id': '13f18862-cd59-44c8-a5c7-08d003e51e26'} Jun 30 12:34:26.532459 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 12:34:26.532459 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:34:26.532459 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 12:34:26.532459 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 12:34:26.532459 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 12:34:26.532459 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 12:34:26.532459 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 12:34:26.532459 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 12:34:26.532459 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 12:34:26.532459 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 12:34:26.532459 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13f18862-cd59-44c8-a5c7-08d003e51e26 could not be found. Jun 30 12:34:26.532459 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:34:26.532459 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:34:26.532459 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:34:26.532459 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:34:26.532459 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:34:26.532459 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:34:26.532459 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 12:34:26.532459 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 12:34:26.532459 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 12:34:26.534042 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 12:34:26.534042 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 30 12:34:26.534042 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 30 12:34:26.534042 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 30 12:34:26.534042 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 30 12:34:26.534042 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 12:34:26.534042 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 12:34:26.534042 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 12:34:26.534042 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 12:34:26.534042 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13f18862-cd59-44c8-a5c7-08d003e51e26 could not be found. Jun 30 12:34:26.534042 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:34:26.534042 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:34:26.534042 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:34:26.534042 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:34:26.534042 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:34:26.534042 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:34:26.534042 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 12:34:26.534042 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 12:34:26.534042 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13f18862-cd59-44c8-a5c7-08d003e51e26 could not be found. Jun 30 12:34:26.534042 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:34:26.535360 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-92418a61-53ac-458c-857d-ef4dbed90e6c tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Returning 404 to user: Instance 13f18862-cd59-44c8-a5c7-08d003e51e26 could not be found. {{(pid=124298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 12:34:26.535932 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-92418a61-53ac-458c-857d-ef4dbed90e6c tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] 10.222.0.57 "DELETE /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26" status: 404 len: 111 microversion: 2.1 time: 0.045512 Jun 30 12:34:26.540124 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 106/213] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 30 12:34:26 2022] DELETE /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 12:34:26.545456 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-39d01324-ffc7-4523-8870-4fa809cc474d tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:26.546532 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-39d01324-ffc7-4523-8870-4fa809cc474d tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] [instance: 13f18862-cd59-44c8-a5c7-08d003e51e26] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:34:26.553377 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-39d01324-ffc7-4523-8870-4fa809cc474d tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:26.554095 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-39d01324-ffc7-4523-8870-4fa809cc474d tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:26.555162 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-39d01324-ffc7-4523-8870-4fa809cc474d tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:26.555865 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-39d01324-ffc7-4523-8870-4fa809cc474d tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:26.572277 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.wsgi [None req-39d01324-ffc7-4523-8870-4fa809cc474d tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] HTTP exception thrown: Instance 13f18862-cd59-44c8-a5c7-08d003e51e26 could not be found. Jun 30 12:34:26.574432 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-39d01324-ffc7-4523-8870-4fa809cc474d tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Request method failure captured: Jun 30 12:34:26.574432 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: request: GET /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26 HTTP/1.1 Jun 30 12:34:26.574432 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Accept: application/json Jun 30 12:34:26.574432 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Accept-Encoding: identity Jun 30 12:34:26.574432 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Connection: close Jun 30 12:34:26.574432 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Content-Length: 0 Jun 30 12:34:26.574432 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Content-Type: application/json Jun 30 12:34:26.574432 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Host: 10.222.0.57 Jun 30 12:34:26.574432 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Openstack-System-Scope: None Jun 30 12:34:26.574432 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: User-Agent: python-urllib3/1.26.9 Jun 30 12:34:26.574432 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Auth-Token: gAAAAABivZf8Z3y3PUxpTtIeWtt7kreEFLDF7vk9sK-5Bu7AV6gil2Tej37tsCJYE0TrsFUbTxMFwZoI-h5AZmFPGg9sVzJ8nHIidFKQtxqT8y2_t2B5kLRy9w9r11Rz0tf9Jsjh05JKYZLlT7Sp33kWVqpfV9JpexESitN0A6bWa6J17Wrn4W0 Jun 30 12:34:26.574432 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Domain-Id: None Jun 30 12:34:26.574432 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Domain-Name: None Jun 30 12:34:26.574432 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Identity-Status: Confirmed Jun 30 12:34:26.574432 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Is-Admin-Project: True Jun 30 12:34:26.574432 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Domain-Id: default Jun 30 12:34:26.574432 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Domain-Name: Default Jun 30 12:34:26.574432 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Id: 8fe4f134e4084a878a5e5cf59d96630f Jun 30 12:34:26.574432 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Name: tempest-DeleteServersTestJSON-1034005234 Jun 30 12:34:26.574432 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Role: member,reader Jun 30 12:34:26.574432 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Roles: member,reader Jun 30 12:34:26.575568 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/8fe4f134e4084a878a5e5cf59d96630f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8fe4f134e4084a878a5e5cf59d96630f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_8fe4f134e4084a878a5e5cf59d96630f", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8fe4f134e4084a878a5e5cf59d96630f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 30 12:34:26.575568 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant: tempest-DeleteServersTestJSON-1034005234 Jun 30 12:34:26.575568 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant-Id: 8fe4f134e4084a878a5e5cf59d96630f Jun 30 12:34:26.575568 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant-Name: tempest-DeleteServersTestJSON-1034005234 Jun 30 12:34:26.575568 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User: tempest-DeleteServersTestJSON-1034005234-project Jun 30 12:34:26.575568 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Domain-Id: default Jun 30 12:34:26.575568 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Domain-Name: Default Jun 30 12:34:26.575568 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Id: 3b688425466947198520ec7554bb49f7 Jun 30 12:34:26.575568 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Name: tempest-DeleteServersTestJSON-1034005234-project Jun 30 12:34:26.575568 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: method: > Jun 30 12:34:26.575568 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: exception: Instance 13f18862-cd59-44c8-a5c7-08d003e51e26 could not be found. Jun 30 12:34:26.575568 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: action_args: {'id': '13f18862-cd59-44c8-a5c7-08d003e51e26'} Jun 30 12:34:26.576284 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 12:34:26.576284 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:34:26.576284 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 12:34:26.576284 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 12:34:26.576284 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 12:34:26.576284 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 12:34:26.576284 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 12:34:26.576284 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 12:34:26.576284 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 12:34:26.576284 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 12:34:26.576284 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13f18862-cd59-44c8-a5c7-08d003e51e26 could not be found. Jun 30 12:34:26.576284 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:34:26.576284 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:34:26.576284 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:34:26.576284 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:34:26.576284 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:34:26.576284 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:34:26.576284 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 12:34:26.576284 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 12:34:26.576284 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 12:34:26.577369 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 12:34:26.577369 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 12:34:26.577369 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 12:34:26.577369 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 12:34:26.577369 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 12:34:26.577369 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 12:34:26.577369 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 12:34:26.577369 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13f18862-cd59-44c8-a5c7-08d003e51e26 could not be found. Jun 30 12:34:26.577369 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:34:26.577369 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:34:26.577369 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:34:26.577369 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:34:26.577369 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:34:26.577369 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:34:26.577369 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 12:34:26.577369 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 12:34:26.577369 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13f18862-cd59-44c8-a5c7-08d003e51e26 could not be found. Jun 30 12:34:26.577369 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:34:26.579828 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-39d01324-ffc7-4523-8870-4fa809cc474d tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] Returning 404 to user: Instance 13f18862-cd59-44c8-a5c7-08d003e51e26 could not be found. {{(pid=124298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 12:34:26.580987 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-39d01324-ffc7-4523-8870-4fa809cc474d tempest-DeleteServersTestJSON-1034005234 tempest-DeleteServersTestJSON-1034005234-project] 10.222.0.57 "GET /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26" status: 404 len: 111 microversion: 2.1 time: 0.039726 Jun 30 12:34:26.581550 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 107/214] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:34:26 2022] GET /compute/v2.1/servers/13f18862-cd59-44c8-a5c7-08d003e51e26 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 12:34:26.905195 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-05bba7ea-5151-4aec-b039-aabf7897fe19 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:34:26.913684 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-05bba7ea-5151-4aec-b039-aabf7897fe19 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61" status: 200 len: 1523 microversion: 2.1 time: 0.460877 Jun 30 12:34:26.914476 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 108/215] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:34:26 2022] GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61 => generated 1523 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:34:27.932761 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-1a89f188-3f4e-4b56-93f2-5644abb8d47f tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:27.935927 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-1a89f188-3f4e-4b56-93f2-5644abb8d47f tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: a2fe3bb8-40b2-4dea-818a-083e0bc5fb61] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:34:27.963396 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-1a89f188-3f4e-4b56-93f2-5644abb8d47f tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:27.963981 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-1a89f188-3f4e-4b56-93f2-5644abb8d47f tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:27.965303 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-1a89f188-3f4e-4b56-93f2-5644abb8d47f tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:27.965868 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-1a89f188-3f4e-4b56-93f2-5644abb8d47f tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:28.323922 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-1a89f188-3f4e-4b56-93f2-5644abb8d47f tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:34:28.333455 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-1a89f188-3f4e-4b56-93f2-5644abb8d47f tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61" status: 200 len: 1523 microversion: 2.1 time: 0.405626 Jun 30 12:34:28.340091 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 108/216] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:34:27 2022] GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61 => generated 1523 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:34:29.355815 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-a46563a3-2951-4167-aaf7-499958254b9b tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:29.356696 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-a46563a3-2951-4167-aaf7-499958254b9b tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: a2fe3bb8-40b2-4dea-818a-083e0bc5fb61] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:34:29.364551 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-a46563a3-2951-4167-aaf7-499958254b9b tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:29.365131 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-a46563a3-2951-4167-aaf7-499958254b9b tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:29.365977 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-a46563a3-2951-4167-aaf7-499958254b9b tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:29.367274 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-a46563a3-2951-4167-aaf7-499958254b9b tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:29.942538 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-a46563a3-2951-4167-aaf7-499958254b9b tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:34:29.953915 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-a46563a3-2951-4167-aaf7-499958254b9b tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61" status: 200 len: 1523 microversion: 2.1 time: 0.603543 Jun 30 12:34:29.961262 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 109/217] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:34:29 2022] GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61 => generated 1523 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:34:30.977594 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-4df3a2fc-9921-4a73-a0be-49b1c301e46d tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:30.978874 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-4df3a2fc-9921-4a73-a0be-49b1c301e46d tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: a2fe3bb8-40b2-4dea-818a-083e0bc5fb61] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:34:30.981609 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG dbcounter [-] [124298] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1 {{(pid=124298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:34:30.988818 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-4df3a2fc-9921-4a73-a0be-49b1c301e46d tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:30.989559 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-4df3a2fc-9921-4a73-a0be-49b1c301e46d tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:30.990685 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-4df3a2fc-9921-4a73-a0be-49b1c301e46d tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:30.991302 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-4df3a2fc-9921-4a73-a0be-49b1c301e46d tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:31.383148 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-4df3a2fc-9921-4a73-a0be-49b1c301e46d tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:34:31.392354 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-4df3a2fc-9921-4a73-a0be-49b1c301e46d tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61" status: 200 len: 1523 microversion: 2.1 time: 0.418497 Jun 30 12:34:31.404202 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 109/218] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:34:30 2022] GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61 => generated 1523 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:34:32.410168 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-d539b346-cefa-42e1-a877-f1f7c2fa36af tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:32.410780 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-d539b346-cefa-42e1-a877-f1f7c2fa36af tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: a2fe3bb8-40b2-4dea-818a-083e0bc5fb61] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:34:32.431698 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-d539b346-cefa-42e1-a877-f1f7c2fa36af tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:32.432108 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-d539b346-cefa-42e1-a877-f1f7c2fa36af tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:32.432928 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-d539b346-cefa-42e1-a877-f1f7c2fa36af tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:32.433368 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-d539b346-cefa-42e1-a877-f1f7c2fa36af tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:32.882186 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-d539b346-cefa-42e1-a877-f1f7c2fa36af tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:34:32.890766 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-d539b346-cefa-42e1-a877-f1f7c2fa36af tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61" status: 200 len: 1523 microversion: 2.1 time: 0.484574 Jun 30 12:34:32.891692 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 110/219] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:34:32 2022] GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61 => generated 1523 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:34:33.276796 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-1ee8637b-82fc-467f-8d6f-2b971911d7b6 tempest-VolumesSnapshotsTestJSON-1851455789 tempest-VolumesSnapshotsTestJSON-1851455789-project] Action: 'create', calling method: .version_select at 0x7fd0e03a15e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1900187991"}} {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:34:33.620459 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-1ee8637b-82fc-467f-8d6f-2b971911d7b6 tempest-VolumesSnapshotsTestJSON-1851455789 tempest-VolumesSnapshotsTestJSON-1851455789-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.587494 Jun 30 12:34:33.627126 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 110/220] 10.222.0.57 () {60 vars in 1154 bytes} [Thu Jun 30 12:34:33 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 590 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 30 12:34:33.632995 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-b15cbb8c-b11e-4b9e-bb80-0f1b966b5153 tempest-VolumesSnapshotsTestJSON-1851455789 tempest-VolumesSnapshotsTestJSON-1851455789-project] Calling method '.version_select at 0x7fd0e033f9d0>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:33.685187 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-b15cbb8c-b11e-4b9e-bb80-0f1b966b5153 tempest-VolumesSnapshotsTestJSON-1851455789 tempest-VolumesSnapshotsTestJSON-1851455789-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/10d02853-9b66-47ee-8f00-bfc5f8dc8436" status: 200 len: 345 microversion: 2.1 time: 0.056336 Jun 30 12:34:33.685750 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 111/221] 10.222.0.57 () {58 vars in 1244 bytes} [Thu Jun 30 12:34:33 2022] GET /compute/v2.1/os-volumes/10d02853-9b66-47ee-8f00-bfc5f8dc8436 => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 12:34:33.909226 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-3d68031f-c993-486b-9f1b-f582da0ef78c tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:33.910085 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-3d68031f-c993-486b-9f1b-f582da0ef78c tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: a2fe3bb8-40b2-4dea-818a-083e0bc5fb61] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:34:33.917363 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-3d68031f-c993-486b-9f1b-f582da0ef78c tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:33.918255 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-3d68031f-c993-486b-9f1b-f582da0ef78c tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:33.919666 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-3d68031f-c993-486b-9f1b-f582da0ef78c tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:33.920753 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-3d68031f-c993-486b-9f1b-f582da0ef78c tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:34.079151 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-3d68031f-c993-486b-9f1b-f582da0ef78c tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:34:34.089048 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-3d68031f-c993-486b-9f1b-f582da0ef78c tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61" status: 200 len: 1523 microversion: 2.1 time: 0.185281 Jun 30 12:34:34.098337 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 111/222] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:34:33 2022] GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61 => generated 1523 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:34:34.697811 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-541fba67-293c-4ad1-a5a0-53162cb33f0b tempest-VolumesSnapshotsTestJSON-1851455789 tempest-VolumesSnapshotsTestJSON-1851455789-project] Calling method '.version_select at 0x7fd0e05d95e0>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:34.754072 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-541fba67-293c-4ad1-a5a0-53162cb33f0b tempest-VolumesSnapshotsTestJSON-1851455789 tempest-VolumesSnapshotsTestJSON-1851455789-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/10d02853-9b66-47ee-8f00-bfc5f8dc8436" status: 200 len: 345 microversion: 2.1 time: 0.059959 Jun 30 12:34:34.754657 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 112/223] 10.222.0.57 () {58 vars in 1244 bytes} [Thu Jun 30 12:34:34 2022] GET /compute/v2.1/os-volumes/10d02853-9b66-47ee-8f00-bfc5f8dc8436 => generated 345 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:34:35.109724 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-c0f8a4c2-1382-4712-bbda-eb4f55d98475 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:35.110396 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-c0f8a4c2-1382-4712-bbda-eb4f55d98475 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: a2fe3bb8-40b2-4dea-818a-083e0bc5fb61] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:34:35.116721 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-c0f8a4c2-1382-4712-bbda-eb4f55d98475 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:35.117157 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-c0f8a4c2-1382-4712-bbda-eb4f55d98475 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:35.117958 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-c0f8a4c2-1382-4712-bbda-eb4f55d98475 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:35.118391 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-c0f8a4c2-1382-4712-bbda-eb4f55d98475 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:35.262920 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-c0f8a4c2-1382-4712-bbda-eb4f55d98475 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:34:35.271101 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-c0f8a4c2-1382-4712-bbda-eb4f55d98475 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61" status: 200 len: 1523 microversion: 2.1 time: 0.167968 Jun 30 12:34:35.271669 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 112/224] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:34:35 2022] GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61 => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:34:35.767347 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-b38effed-033d-4309-9f8b-98a9460dbefd tempest-VolumesSnapshotsTestJSON-1851455789 tempest-VolumesSnapshotsTestJSON-1851455789-project] Calling method '.version_select at 0x7fd0e02d5430>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:35.817982 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-b38effed-033d-4309-9f8b-98a9460dbefd tempest-VolumesSnapshotsTestJSON-1851455789 tempest-VolumesSnapshotsTestJSON-1851455789-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/10d02853-9b66-47ee-8f00-bfc5f8dc8436" status: 200 len: 345 microversion: 2.1 time: 0.055184 Jun 30 12:34:35.818725 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 113/225] 10.222.0.57 () {58 vars in 1244 bytes} [Thu Jun 30 12:34:35 2022] GET /compute/v2.1/os-volumes/10d02853-9b66-47ee-8f00-bfc5f8dc8436 => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:34:36.288693 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-fc6dd147-0cee-45b8-9d3b-7e748f95736f tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:36.290033 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-fc6dd147-0cee-45b8-9d3b-7e748f95736f tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: a2fe3bb8-40b2-4dea-818a-083e0bc5fb61] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:34:36.297193 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-fc6dd147-0cee-45b8-9d3b-7e748f95736f tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:36.297797 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-fc6dd147-0cee-45b8-9d3b-7e748f95736f tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:36.298711 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-fc6dd147-0cee-45b8-9d3b-7e748f95736f tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:36.299643 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-fc6dd147-0cee-45b8-9d3b-7e748f95736f tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:36.525031 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-fc6dd147-0cee-45b8-9d3b-7e748f95736f tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:34:36.533725 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-fc6dd147-0cee-45b8-9d3b-7e748f95736f tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61" status: 200 len: 1523 microversion: 2.1 time: 0.249500 Jun 30 12:34:36.534970 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 113/226] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:34:36 2022] GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61 => generated 1523 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:34:36.831840 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-19b1057d-6782-4c0d-8a9e-d848c9c0fb54 tempest-VolumesSnapshotsTestJSON-1851455789 tempest-VolumesSnapshotsTestJSON-1851455789-project] Calling method '.version_select at 0x7fd0e033fa60>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:36.905575 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-19b1057d-6782-4c0d-8a9e-d848c9c0fb54 tempest-VolumesSnapshotsTestJSON-1851455789 tempest-VolumesSnapshotsTestJSON-1851455789-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/10d02853-9b66-47ee-8f00-bfc5f8dc8436" status: 200 len: 346 microversion: 2.1 time: 0.078458 Jun 30 12:34:36.906120 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 114/227] 10.222.0.57 () {58 vars in 1244 bytes} [Thu Jun 30 12:34:36 2022] GET /compute/v2.1/os-volumes/10d02853-9b66-47ee-8f00-bfc5f8dc8436 => generated 346 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:34:36.927931 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-b99febf0-765c-4ea8-86fb-935dd4b31dbf tempest-VolumesSnapshotsTestJSON-1851455789 tempest-VolumesSnapshotsTestJSON-1851455789-project] Action: 'create', calling method: .version_select at 0x7fd0e039eca0>, body: {"snapshot": {"volume_id": "10d02853-9b66-47ee-8f00-bfc5f8dc8436", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-978094100"}} {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:34:37.277900 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-b99febf0-765c-4ea8-86fb-935dd4b31dbf tempest-VolumesSnapshotsTestJSON-1851455789 tempest-VolumesSnapshotsTestJSON-1851455789-project] 10.222.0.57 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.364293 Jun 30 12:34:37.278792 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 114/228] 10.222.0.57 () {60 vars in 1161 bytes} [Thu Jun 30 12:34:36 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:34:37.290150 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-97a2a158-a338-44f1-bc98-e2ce42c43472 tempest-VolumesSnapshotsTestJSON-1851455789 tempest-VolumesSnapshotsTestJSON-1851455789-project] Calling method '.version_select at 0x7fd0e03438b0>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:37.342273 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-97a2a158-a338-44f1-bc98-e2ce42c43472 tempest-VolumesSnapshotsTestJSON-1851455789 tempest-VolumesSnapshotsTestJSON-1851455789-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/5de2de1b-3f5c-41fd-8e27-639f45f1aee5" status: 200 len: 286 microversion: 2.1 time: 0.056514 Jun 30 12:34:37.342831 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 115/229] 10.222.0.57 () {58 vars in 1250 bytes} [Thu Jun 30 12:34:37 2022] GET /compute/v2.1/os-snapshots/5de2de1b-3f5c-41fd-8e27-639f45f1aee5 => generated 286 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 12:34:37.353618 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-042b9ac5-dd1d-449e-bde6-3fb81fd4c041 tempest-VolumesSnapshotsTestJSON-1851455789 tempest-VolumesSnapshotsTestJSON-1851455789-project] Calling method '.version_select at 0x7fd0e03f4ca0>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:37.387186 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-042b9ac5-dd1d-449e-bde6-3fb81fd4c041 tempest-VolumesSnapshotsTestJSON-1851455789 tempest-VolumesSnapshotsTestJSON-1851455789-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.037520 Jun 30 12:34:37.387843 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 115/230] 10.222.0.57 () {58 vars in 1139 bytes} [Thu Jun 30 12:34:37 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:34:37.399724 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-f438edc0-ee11-49b4-ad27-f1f515a28bf1 tempest-VolumesSnapshotsTestJSON-1851455789 tempest-VolumesSnapshotsTestJSON-1851455789-project] Calling method '.version_select at 0x7fd0e02d5700>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:37.432720 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-f438edc0-ee11-49b4-ad27-f1f515a28bf1 tempest-VolumesSnapshotsTestJSON-1851455789 tempest-VolumesSnapshotsTestJSON-1851455789-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/5de2de1b-3f5c-41fd-8e27-639f45f1aee5" status: 200 len: 286 microversion: 2.1 time: 0.037477 Jun 30 12:34:37.433297 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 116/231] 10.222.0.57 () {58 vars in 1250 bytes} [Thu Jun 30 12:34:37 2022] GET /compute/v2.1/os-snapshots/5de2de1b-3f5c-41fd-8e27-639f45f1aee5 => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:34:37.552868 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-cf7c5277-a8ed-4dd7-ad7b-295d87814c06 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:37.555191 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-cf7c5277-a8ed-4dd7-ad7b-295d87814c06 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: a2fe3bb8-40b2-4dea-818a-083e0bc5fb61] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:34:37.563222 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-cf7c5277-a8ed-4dd7-ad7b-295d87814c06 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:37.563765 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-cf7c5277-a8ed-4dd7-ad7b-295d87814c06 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:37.564891 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-cf7c5277-a8ed-4dd7-ad7b-295d87814c06 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:37.565566 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-cf7c5277-a8ed-4dd7-ad7b-295d87814c06 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:37.808544 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-cf7c5277-a8ed-4dd7-ad7b-295d87814c06 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:34:37.824135 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-cf7c5277-a8ed-4dd7-ad7b-295d87814c06 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61" status: 200 len: 1523 microversion: 2.1 time: 0.276234 Jun 30 12:34:37.827326 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 116/232] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:34:37 2022] GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61 => generated 1523 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:34:38.445702 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-c46ae62c-ade6-46a8-b15f-b1d26f9fcee2 tempest-VolumesSnapshotsTestJSON-1851455789 tempest-VolumesSnapshotsTestJSON-1851455789-project] Calling method '.version_select at 0x7fd0e0343790>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:38.481932 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-c46ae62c-ade6-46a8-b15f-b1d26f9fcee2 tempest-VolumesSnapshotsTestJSON-1851455789 tempest-VolumesSnapshotsTestJSON-1851455789-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/5de2de1b-3f5c-41fd-8e27-639f45f1aee5" status: 200 len: 286 microversion: 2.1 time: 0.040986 Jun 30 12:34:38.482750 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 117/233] 10.222.0.57 () {58 vars in 1250 bytes} [Thu Jun 30 12:34:38 2022] GET /compute/v2.1/os-snapshots/5de2de1b-3f5c-41fd-8e27-639f45f1aee5 => generated 286 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 12:34:38.849149 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-4a93b7a6-05b6-4da9-8274-85170ad3d3e5 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:38.850099 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-4a93b7a6-05b6-4da9-8274-85170ad3d3e5 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: a2fe3bb8-40b2-4dea-818a-083e0bc5fb61] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:34:38.865037 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-4a93b7a6-05b6-4da9-8274-85170ad3d3e5 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:38.867412 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-4a93b7a6-05b6-4da9-8274-85170ad3d3e5 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:38.868257 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-4a93b7a6-05b6-4da9-8274-85170ad3d3e5 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:38.868753 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-4a93b7a6-05b6-4da9-8274-85170ad3d3e5 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:39.232475 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-4a93b7a6-05b6-4da9-8274-85170ad3d3e5 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:34:39.249986 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-4a93b7a6-05b6-4da9-8274-85170ad3d3e5 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61" status: 200 len: 1523 microversion: 2.1 time: 0.407261 Jun 30 12:34:39.250905 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 117/234] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:34:38 2022] GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61 => generated 1523 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:34:39.495985 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-d02efc09-b8e6-451a-8d17-ba4c7e5fe566 tempest-VolumesSnapshotsTestJSON-1851455789 tempest-VolumesSnapshotsTestJSON-1851455789-project] Calling method '.version_select at 0x7fd0e040b8b0>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:39.532466 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-d02efc09-b8e6-451a-8d17-ba4c7e5fe566 tempest-VolumesSnapshotsTestJSON-1851455789 tempest-VolumesSnapshotsTestJSON-1851455789-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/5de2de1b-3f5c-41fd-8e27-639f45f1aee5" status: 200 len: 286 microversion: 2.1 time: 0.041667 Jun 30 12:34:39.533108 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 118/235] 10.222.0.57 () {58 vars in 1250 bytes} [Thu Jun 30 12:34:39 2022] GET /compute/v2.1/os-snapshots/5de2de1b-3f5c-41fd-8e27-639f45f1aee5 => generated 286 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:34:40.268223 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-00522367-9ff1-4c04-89ca-fb320af0b4b2 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:40.268882 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-00522367-9ff1-4c04-89ca-fb320af0b4b2 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: a2fe3bb8-40b2-4dea-818a-083e0bc5fb61] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:34:40.276355 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-00522367-9ff1-4c04-89ca-fb320af0b4b2 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:40.276822 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-00522367-9ff1-4c04-89ca-fb320af0b4b2 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:40.277605 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-00522367-9ff1-4c04-89ca-fb320af0b4b2 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:40.278043 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-00522367-9ff1-4c04-89ca-fb320af0b4b2 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:40.522184 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-00522367-9ff1-4c04-89ca-fb320af0b4b2 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:34:40.532463 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-00522367-9ff1-4c04-89ca-fb320af0b4b2 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61" status: 200 len: 1523 microversion: 2.1 time: 0.268890 Jun 30 12:34:40.533777 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 118/236] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:34:40 2022] GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61 => generated 1523 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:34:40.547612 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-a8d65fdf-d635-45ce-a2b4-3afe996fbdd1 tempest-VolumesSnapshotsTestJSON-1851455789 tempest-VolumesSnapshotsTestJSON-1851455789-project] Calling method '.version_select at 0x7fd0e040bca0>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:40.634080 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-a8d65fdf-d635-45ce-a2b4-3afe996fbdd1 tempest-VolumesSnapshotsTestJSON-1851455789 tempest-VolumesSnapshotsTestJSON-1851455789-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/5de2de1b-3f5c-41fd-8e27-639f45f1aee5" status: 200 len: 286 microversion: 2.1 time: 0.091593 Jun 30 12:34:40.634778 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 119/237] 10.222.0.57 () {58 vars in 1250 bytes} [Thu Jun 30 12:34:40 2022] GET /compute/v2.1/os-snapshots/5de2de1b-3f5c-41fd-8e27-639f45f1aee5 => generated 286 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:34:41.550796 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-c2155928-160b-4849-ab61-81cdabaf074f tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:41.551452 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-c2155928-160b-4849-ab61-81cdabaf074f tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: a2fe3bb8-40b2-4dea-818a-083e0bc5fb61] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:34:41.563100 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-c2155928-160b-4849-ab61-81cdabaf074f tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:41.564122 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-c2155928-160b-4849-ab61-81cdabaf074f tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:41.564949 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-c2155928-160b-4849-ab61-81cdabaf074f tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:41.565417 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-c2155928-160b-4849-ab61-81cdabaf074f tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:41.649149 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-a99edd56-2d80-4d76-8e20-0eea135e1f2e tempest-VolumesSnapshotsTestJSON-1851455789 tempest-VolumesSnapshotsTestJSON-1851455789-project] Calling method '.version_select at 0x7fd0e033f1f0>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:41.725931 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-a99edd56-2d80-4d76-8e20-0eea135e1f2e tempest-VolumesSnapshotsTestJSON-1851455789 tempest-VolumesSnapshotsTestJSON-1851455789-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/5de2de1b-3f5c-41fd-8e27-639f45f1aee5" status: 200 len: 287 microversion: 2.1 time: 0.084242 Jun 30 12:34:41.727256 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 120/238] 10.222.0.57 () {58 vars in 1250 bytes} [Thu Jun 30 12:34:41 2022] GET /compute/v2.1/os-snapshots/5de2de1b-3f5c-41fd-8e27-639f45f1aee5 => generated 287 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 12:34:41.743590 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-3000fc80-ccae-4353-9915-02dd47f16973 tempest-VolumesSnapshotsTestJSON-1851455789 tempest-VolumesSnapshotsTestJSON-1851455789-project] Calling method '.version_select at 0x7fd0e02d5d30>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:41.861194 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-c2155928-160b-4849-ab61-81cdabaf074f tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:34:41.870830 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-c2155928-160b-4849-ab61-81cdabaf074f tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61" status: 200 len: 1523 microversion: 2.1 time: 0.325664 Jun 30 12:34:41.872402 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 119/239] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:34:41 2022] GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61 => generated 1523 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:34:41.878991 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-3000fc80-ccae-4353-9915-02dd47f16973 tempest-VolumesSnapshotsTestJSON-1851455789 tempest-VolumesSnapshotsTestJSON-1851455789-project] 10.222.0.57 "DELETE /compute/v2.1/os-snapshots/5de2de1b-3f5c-41fd-8e27-639f45f1aee5" status: 202 len: 0 microversion: 2.1 time: 0.140374 Jun 30 12:34:41.880015 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 121/240] 10.222.0.57 () {58 vars in 1253 bytes} [Thu Jun 30 12:34:41 2022] DELETE /compute/v2.1/os-snapshots/5de2de1b-3f5c-41fd-8e27-639f45f1aee5 => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 12:34:41.892800 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-023a975f-2d13-4832-8860-8aa09ac36c13 tempest-VolumesSnapshotsTestJSON-1851455789 tempest-VolumesSnapshotsTestJSON-1851455789-project] Calling method '.version_select at 0x7fd0e03d1ca0>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:41.953363 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-023a975f-2d13-4832-8860-8aa09ac36c13 tempest-VolumesSnapshotsTestJSON-1851455789 tempest-VolumesSnapshotsTestJSON-1851455789-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/5de2de1b-3f5c-41fd-8e27-639f45f1aee5" status: 200 len: 286 microversion: 2.1 time: 0.067850 Jun 30 12:34:41.954327 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 120/241] 10.222.0.57 () {58 vars in 1250 bytes} [Thu Jun 30 12:34:41 2022] GET /compute/v2.1/os-snapshots/5de2de1b-3f5c-41fd-8e27-639f45f1aee5 => generated 286 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:34:42.889123 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-887c31e6-f212-4f46-94a6-a6085a891030 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:42.889721 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-887c31e6-f212-4f46-94a6-a6085a891030 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: a2fe3bb8-40b2-4dea-818a-083e0bc5fb61] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:34:42.893813 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG dbcounter [-] [124297] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=124297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:34:42.895246 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG dbcounter [-] [124297] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:34:42.911615 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-887c31e6-f212-4f46-94a6-a6085a891030 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:42.912455 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-887c31e6-f212-4f46-94a6-a6085a891030 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:42.913944 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-887c31e6-f212-4f46-94a6-a6085a891030 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:42.914580 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-887c31e6-f212-4f46-94a6-a6085a891030 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:42.979603 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-8724c299-eb30-4012-9850-2c516eeac9a6 tempest-VolumesSnapshotsTestJSON-1851455789 tempest-VolumesSnapshotsTestJSON-1851455789-project] Calling method '.version_select at 0x7fd0e03f48b0>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:43.030765 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.wsgi [None req-8724c299-eb30-4012-9850-2c516eeac9a6 tempest-VolumesSnapshotsTestJSON-1851455789 tempest-VolumesSnapshotsTestJSON-1851455789-project] HTTP exception thrown: Snapshot 5de2de1b-3f5c-41fd-8e27-639f45f1aee5 could not be found. Jun 30 12:34:43.033858 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-8724c299-eb30-4012-9850-2c516eeac9a6 tempest-VolumesSnapshotsTestJSON-1851455789 tempest-VolumesSnapshotsTestJSON-1851455789-project] Request method failure captured: Jun 30 12:34:43.033858 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: request: GET /compute/v2.1/os-snapshots/5de2de1b-3f5c-41fd-8e27-639f45f1aee5 HTTP/1.1 Jun 30 12:34:43.033858 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Accept: application/json Jun 30 12:34:43.033858 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Accept-Encoding: identity Jun 30 12:34:43.033858 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Connection: close Jun 30 12:34:43.033858 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Content-Length: 0 Jun 30 12:34:43.033858 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Content-Type: application/json Jun 30 12:34:43.033858 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Host: 10.222.0.57 Jun 30 12:34:43.033858 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Openstack-System-Scope: None Jun 30 12:34:43.033858 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: User-Agent: python-urllib3/1.26.9 Jun 30 12:34:43.033858 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Auth-Token: gAAAAABivZhYY7-UQ_meofLeuGKMR2-J7oR8ZgB07aAHkEybe9WeyqCMuELsIHXX8TuWOVAxT4TbXv1Nf2hxDmAKAoBgR4xwRUW59PG39JjquixSg5yPRn85xQWrAuP11Jkc5aWNZV422O4s8dpXi9M1G1F-W98r-v_GE30jrKPvkaD6p_l__Tw Jun 30 12:34:43.033858 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Domain-Id: None Jun 30 12:34:43.033858 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Domain-Name: None Jun 30 12:34:43.033858 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Identity-Status: Confirmed Jun 30 12:34:43.033858 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Is-Admin-Project: True Jun 30 12:34:43.033858 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Domain-Id: default Jun 30 12:34:43.033858 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Domain-Name: Default Jun 30 12:34:43.033858 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Id: 63fc82464e41424f93ceda870cd0c1dd Jun 30 12:34:43.033858 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1851455789 Jun 30 12:34:43.033858 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Role: member,reader Jun 30 12:34:43.033858 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Roles: member,reader Jun 30 12:34:43.035157 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/63fc82464e41424f93ceda870cd0c1dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/63fc82464e41424f93ceda870cd0c1dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_63fc82464e41424f93ceda870cd0c1dd", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/63fc82464e41424f93ceda870cd0c1dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 30 12:34:43.035157 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1851455789 Jun 30 12:34:43.035157 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant-Id: 63fc82464e41424f93ceda870cd0c1dd Jun 30 12:34:43.035157 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1851455789 Jun 30 12:34:43.035157 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User: tempest-VolumesSnapshotsTestJSON-1851455789-project Jun 30 12:34:43.035157 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Domain-Id: default Jun 30 12:34:43.035157 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Domain-Name: Default Jun 30 12:34:43.035157 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Id: c468edd5263442e4825dcc4711838579 Jun 30 12:34:43.035157 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1851455789-project Jun 30 12:34:43.035157 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: method: Jun 30 12:34:43.035157 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: exception: Snapshot 5de2de1b-3f5c-41fd-8e27-639f45f1aee5 could not be found. Jun 30 12:34:43.035157 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: action_args: {'id': '5de2de1b-3f5c-41fd-8e27-639f45f1aee5'} Jun 30 12:34:43.035157 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 12:34:43.035972 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:34:43.035972 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 30 12:34:43.035972 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 30 12:34:43.035972 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 30 12:34:43.035972 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 30 12:34:43.035972 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 30 12:34:43.035972 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 30 12:34:43.035972 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 30 12:34:43.035972 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 30 12:34:43.035972 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 30 12:34:43.035972 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 30 12:34:43.035972 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 12:34:43.035972 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 12:34:43.035972 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 12:34:43.035972 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 12:34:43.035972 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 5de2de1b-3f5c-41fd-8e27-639f45f1aee5 could not be found. (HTTP 404) (Request-ID: req-64ab7e07-983a-46ab-a121-c2e0103c1c79) Jun 30 12:34:43.035972 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:34:43.035972 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:34:43.036979 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:34:43.036979 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:34:43.036979 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 30 12:34:43.036979 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 30 12:34:43.036979 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 30 12:34:43.036979 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 30 12:34:43.036979 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 30 12:34:43.036979 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 30 12:34:43.036979 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 30 12:34:43.036979 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 30 12:34:43.036979 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 30 12:34:43.036979 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 30 12:34:43.036979 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 30 12:34:43.036979 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 30 12:34:43.036979 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 30 12:34:43.036979 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 30 12:34:43.036979 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 30 12:34:43.036979 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 30 12:34:43.036979 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 30 12:34:43.040362 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 30 12:34:43.040362 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 12:34:43.040362 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 12:34:43.040362 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 12:34:43.040362 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 12:34:43.040362 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 5de2de1b-3f5c-41fd-8e27-639f45f1aee5 could not be found. Jun 30 12:34:43.040362 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:34:43.040362 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:34:43.040362 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:34:43.040362 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:34:43.040362 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:34:43.040362 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:34:43.040362 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 12:34:43.040362 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 12:34:43.040362 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 30 12:34:43.040362 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 30 12:34:43.040362 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 12:34:43.040362 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 12:34:43.040362 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 30 12:34:43.040362 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 12:34:43.041636 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 5de2de1b-3f5c-41fd-8e27-639f45f1aee5 could not be found. Jun 30 12:34:43.041636 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:34:43.041636 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:34:43.041636 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:34:43.041636 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:34:43.041636 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:34:43.041636 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:34:43.041636 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 12:34:43.041636 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 12:34:43.041636 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 5de2de1b-3f5c-41fd-8e27-639f45f1aee5 could not be found. Jun 30 12:34:43.041636 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:34:43.045367 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-8724c299-eb30-4012-9850-2c516eeac9a6 tempest-VolumesSnapshotsTestJSON-1851455789 tempest-VolumesSnapshotsTestJSON-1851455789-project] Returning 404 to user: Snapshot 5de2de1b-3f5c-41fd-8e27-639f45f1aee5 could not be found. {{(pid=124298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 12:34:43.046471 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-8724c299-eb30-4012-9850-2c516eeac9a6 tempest-VolumesSnapshotsTestJSON-1851455789 tempest-VolumesSnapshotsTestJSON-1851455789-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/5de2de1b-3f5c-41fd-8e27-639f45f1aee5" status: 404 len: 111 microversion: 2.1 time: 0.084911 Jun 30 12:34:43.051510 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 121/242] 10.222.0.57 () {58 vars in 1250 bytes} [Thu Jun 30 12:34:42 2022] GET /compute/v2.1/os-snapshots/5de2de1b-3f5c-41fd-8e27-639f45f1aee5 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 30 12:34:43.059246 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-bd765edb-63b9-4801-abec-7530a7a70fa7 tempest-VolumesSnapshotsTestJSON-1851455789 tempest-VolumesSnapshotsTestJSON-1851455789-project] Calling method '.version_select at 0x7fd0e03f4e50>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:43.193380 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-bd765edb-63b9-4801-abec-7530a7a70fa7 tempest-VolumesSnapshotsTestJSON-1851455789 tempest-VolumesSnapshotsTestJSON-1851455789-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/10d02853-9b66-47ee-8f00-bfc5f8dc8436" status: 202 len: 0 microversion: 2.1 time: 0.139934 Jun 30 12:34:43.204945 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 122/243] 10.222.0.57 () {58 vars in 1247 bytes} [Thu Jun 30 12:34:43 2022] DELETE /compute/v2.1/os-volumes/10d02853-9b66-47ee-8f00-bfc5f8dc8436 => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 12:34:43.209353 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-887c31e6-f212-4f46-94a6-a6085a891030 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:34:43.210802 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-add7cca9-5e26-4610-9fe4-f6ee22d009c0 tempest-VolumesSnapshotsTestJSON-1851455789 tempest-VolumesSnapshotsTestJSON-1851455789-project] Calling method '.version_select at 0x7fd0e03d1c10>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:43.221724 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-887c31e6-f212-4f46-94a6-a6085a891030 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61" status: 200 len: 1503 microversion: 2.1 time: 0.334077 Jun 30 12:34:43.230165 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 122/244] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:34:42 2022] GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61 => generated 1503 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:34:43.247736 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-45fce43b-7815-4dd4-aaf5-c65a04986a56 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:43.248345 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-45fce43b-7815-4dd4-aaf5-c65a04986a56 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: 99a31213-cbcb-4b2c-b07f-ab67e78a2096] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:34:43.255137 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-45fce43b-7815-4dd4-aaf5-c65a04986a56 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:43.255577 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-45fce43b-7815-4dd4-aaf5-c65a04986a56 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:43.256342 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-45fce43b-7815-4dd4-aaf5-c65a04986a56 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:43.256801 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-45fce43b-7815-4dd4-aaf5-c65a04986a56 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:43.426444 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-add7cca9-5e26-4610-9fe4-f6ee22d009c0 tempest-VolumesSnapshotsTestJSON-1851455789 tempest-VolumesSnapshotsTestJSON-1851455789-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/10d02853-9b66-47ee-8f00-bfc5f8dc8436" status: 200 len: 345 microversion: 2.1 time: 0.220157 Jun 30 12:34:43.427326 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 123/245] 10.222.0.57 () {58 vars in 1244 bytes} [Thu Jun 30 12:34:43 2022] GET /compute/v2.1/os-volumes/10d02853-9b66-47ee-8f00-bfc5f8dc8436 => generated 345 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:34:43.519920 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-45fce43b-7815-4dd4-aaf5-c65a04986a56 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:34:43.532900 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-45fce43b-7815-4dd4-aaf5-c65a04986a56 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/99a31213-cbcb-4b2c-b07f-ab67e78a2096" status: 200 len: 1516 microversion: 2.1 time: 0.288671 Jun 30 12:34:43.534602 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 123/246] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:34:43 2022] GET /compute/v2.1/servers/99a31213-cbcb-4b2c-b07f-ab67e78a2096 => generated 1516 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:34:44.440097 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-9ae09ca2-f84f-47a9-a37e-3685fc5a4092 tempest-VolumesSnapshotsTestJSON-1851455789 tempest-VolumesSnapshotsTestJSON-1851455789-project] Calling method '.version_select at 0x7fd0e04abca0>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:44.505843 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-9ae09ca2-f84f-47a9-a37e-3685fc5a4092 tempest-VolumesSnapshotsTestJSON-1851455789 tempest-VolumesSnapshotsTestJSON-1851455789-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/10d02853-9b66-47ee-8f00-bfc5f8dc8436" status: 200 len: 345 microversion: 2.1 time: 0.070093 Jun 30 12:34:44.507246 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 124/247] 10.222.0.57 () {58 vars in 1244 bytes} [Thu Jun 30 12:34:44 2022] GET /compute/v2.1/os-volumes/10d02853-9b66-47ee-8f00-bfc5f8dc8436 => generated 345 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:34:45.523784 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-625502b5-3691-4ec4-87e3-1c55c41648ea tempest-VolumesSnapshotsTestJSON-1851455789 tempest-VolumesSnapshotsTestJSON-1851455789-project] Calling method '.version_select at 0x7fd0e0551040>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:45.602369 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-625502b5-3691-4ec4-87e3-1c55c41648ea tempest-VolumesSnapshotsTestJSON-1851455789 tempest-VolumesSnapshotsTestJSON-1851455789-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/10d02853-9b66-47ee-8f00-bfc5f8dc8436" status: 200 len: 345 microversion: 2.1 time: 0.082503 Jun 30 12:34:45.602926 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 124/248] 10.222.0.57 () {58 vars in 1244 bytes} [Thu Jun 30 12:34:45 2022] GET /compute/v2.1/os-volumes/10d02853-9b66-47ee-8f00-bfc5f8dc8436 => generated 345 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:34:46.615383 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-655519a6-7efe-4f92-8938-84ab7e6528ea tempest-VolumesSnapshotsTestJSON-1851455789 tempest-VolumesSnapshotsTestJSON-1851455789-project] Calling method '.version_select at 0x7fd0e03a1af0>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:46.677228 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-655519a6-7efe-4f92-8938-84ab7e6528ea tempest-VolumesSnapshotsTestJSON-1851455789 tempest-VolumesSnapshotsTestJSON-1851455789-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/10d02853-9b66-47ee-8f00-bfc5f8dc8436" status: 200 len: 345 microversion: 2.1 time: 0.065859 Jun 30 12:34:46.677984 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 125/249] 10.222.0.57 () {58 vars in 1244 bytes} [Thu Jun 30 12:34:46 2022] GET /compute/v2.1/os-volumes/10d02853-9b66-47ee-8f00-bfc5f8dc8436 => generated 345 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:34:47.698317 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-a668f435-0b26-4d1e-9ba0-fdfc8a23ba1a tempest-VolumesSnapshotsTestJSON-1851455789 tempest-VolumesSnapshotsTestJSON-1851455789-project] Calling method '.version_select at 0x7fd0e033f1f0>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:47.754267 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-a668f435-0b26-4d1e-9ba0-fdfc8a23ba1a tempest-VolumesSnapshotsTestJSON-1851455789 tempest-VolumesSnapshotsTestJSON-1851455789-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/10d02853-9b66-47ee-8f00-bfc5f8dc8436" status: 200 len: 345 microversion: 2.1 time: 0.064669 Jun 30 12:34:47.759971 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 125/250] 10.222.0.57 () {58 vars in 1244 bytes} [Thu Jun 30 12:34:47 2022] GET /compute/v2.1/os-volumes/10d02853-9b66-47ee-8f00-bfc5f8dc8436 => generated 345 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:34:48.770097 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-8d83cea4-2d0d-4e07-b58e-a50f42835ffd tempest-VolumesSnapshotsTestJSON-1851455789 tempest-VolumesSnapshotsTestJSON-1851455789-project] Calling method '.version_select at 0x7fd0e03a1b80>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:48.842094 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-8d83cea4-2d0d-4e07-b58e-a50f42835ffd tempest-VolumesSnapshotsTestJSON-1851455789 tempest-VolumesSnapshotsTestJSON-1851455789-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/10d02853-9b66-47ee-8f00-bfc5f8dc8436" status: 200 len: 345 microversion: 2.1 time: 0.077766 Jun 30 12:34:48.847396 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 126/251] 10.222.0.57 () {58 vars in 1244 bytes} [Thu Jun 30 12:34:48 2022] GET /compute/v2.1/os-volumes/10d02853-9b66-47ee-8f00-bfc5f8dc8436 => generated 345 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:34:49.525581 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-180d53e6-06b5-470b-9205-fa38ff156348 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:34:49.526836 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-180d53e6-06b5-470b-9205-fa38ff156348 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: 99a31213-cbcb-4b2c-b07f-ab67e78a2096] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:34:49.534348 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-180d53e6-06b5-470b-9205-fa38ff156348 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:49.535265 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-180d53e6-06b5-470b-9205-fa38ff156348 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:49.538474 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-180d53e6-06b5-470b-9205-fa38ff156348 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:49.539120 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-180d53e6-06b5-470b-9205-fa38ff156348 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:49.564740 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.objects.instance [None req-180d53e6-06b5-470b-9205-fa38ff156348 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lazy-loading 'flavor' on Instance uuid 99a31213-cbcb-4b2c-b07f-ab67e78a2096 {{(pid=124297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 12:34:49.659977 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-180d53e6-06b5-470b-9205-fa38ff156348 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "POST /compute/v2.1/servers/99a31213-cbcb-4b2c-b07f-ab67e78a2096/action" status: 200 len: 32 microversion: 2.1 time: 0.139632 Jun 30 12:34:49.661320 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 126/252] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Jun 30 12:34:49 2022] POST /compute/v2.1/servers/99a31213-cbcb-4b2c-b07f-ab67e78a2096/action => generated 32 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 30 12:34:49.670536 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-bda1c73b-7bdf-48ba-a397-6f2c132457fc tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:49.671130 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-bda1c73b-7bdf-48ba-a397-6f2c132457fc tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: 99a31213-cbcb-4b2c-b07f-ab67e78a2096] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:34:49.677714 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-bda1c73b-7bdf-48ba-a397-6f2c132457fc tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:49.678183 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-bda1c73b-7bdf-48ba-a397-6f2c132457fc tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:49.678947 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-bda1c73b-7bdf-48ba-a397-6f2c132457fc tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:49.679428 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-bda1c73b-7bdf-48ba-a397-6f2c132457fc tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:49.857701 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-bda1c73b-7bdf-48ba-a397-6f2c132457fc tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:34:49.858845 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-fc37cde3-dd94-4f10-87ea-16077c8dbfdd tempest-VolumesSnapshotsTestJSON-1851455789 tempest-VolumesSnapshotsTestJSON-1851455789-project] Calling method '.version_select at 0x7fd0e033fb80>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:49.868344 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-bda1c73b-7bdf-48ba-a397-6f2c132457fc tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/99a31213-cbcb-4b2c-b07f-ab67e78a2096" status: 200 len: 1522 microversion: 2.1 time: 0.202039 Jun 30 12:34:49.869876 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 127/253] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:34:49 2022] GET /compute/v2.1/servers/99a31213-cbcb-4b2c-b07f-ab67e78a2096 => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:34:49.934544 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-fc37cde3-dd94-4f10-87ea-16077c8dbfdd tempest-VolumesSnapshotsTestJSON-1851455789 tempest-VolumesSnapshotsTestJSON-1851455789-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/10d02853-9b66-47ee-8f00-bfc5f8dc8436" status: 200 len: 345 microversion: 2.1 time: 0.082767 Jun 30 12:34:49.935116 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 127/254] 10.222.0.57 () {58 vars in 1244 bytes} [Thu Jun 30 12:34:49 2022] GET /compute/v2.1/os-volumes/10d02853-9b66-47ee-8f00-bfc5f8dc8436 => generated 345 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:34:50.886857 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-ce752d21-f159-4862-8328-caa192930e93 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:50.887451 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-ce752d21-f159-4862-8328-caa192930e93 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: 99a31213-cbcb-4b2c-b07f-ab67e78a2096] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:34:50.894902 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-ce752d21-f159-4862-8328-caa192930e93 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:50.895346 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-ce752d21-f159-4862-8328-caa192930e93 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:50.896120 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-ce752d21-f159-4862-8328-caa192930e93 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:50.896558 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-ce752d21-f159-4862-8328-caa192930e93 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:50.947418 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-d555c5c2-a614-4cb4-9c9d-d8b73ac6733b tempest-VolumesSnapshotsTestJSON-1851455789 tempest-VolumesSnapshotsTestJSON-1851455789-project] Calling method '.version_select at 0x7fd0e0616670>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:51.005709 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-d555c5c2-a614-4cb4-9c9d-d8b73ac6733b tempest-VolumesSnapshotsTestJSON-1851455789 tempest-VolumesSnapshotsTestJSON-1851455789-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/10d02853-9b66-47ee-8f00-bfc5f8dc8436" status: 200 len: 345 microversion: 2.1 time: 0.061459 Jun 30 12:34:51.006578 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 128/255] 10.222.0.57 () {58 vars in 1244 bytes} [Thu Jun 30 12:34:50 2022] GET /compute/v2.1/os-volumes/10d02853-9b66-47ee-8f00-bfc5f8dc8436 => generated 345 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:34:51.050312 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-ce752d21-f159-4862-8328-caa192930e93 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:34:51.058621 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-ce752d21-f159-4862-8328-caa192930e93 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/99a31213-cbcb-4b2c-b07f-ab67e78a2096" status: 200 len: 1522 microversion: 2.1 time: 0.175945 Jun 30 12:34:51.059507 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 128/256] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:34:50 2022] GET /compute/v2.1/servers/99a31213-cbcb-4b2c-b07f-ab67e78a2096 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:34:52.021766 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-16e68cd6-2d14-4f98-8959-713f3ba9a345 tempest-VolumesSnapshotsTestJSON-1851455789 tempest-VolumesSnapshotsTestJSON-1851455789-project] Calling method '.version_select at 0x7fd0e05d9e50>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:52.077633 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-fcb5fa8e-fec0-4781-9913-77b939ca23f5 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:52.078317 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-fcb5fa8e-fec0-4781-9913-77b939ca23f5 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: 99a31213-cbcb-4b2c-b07f-ab67e78a2096] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:34:52.082573 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-16e68cd6-2d14-4f98-8959-713f3ba9a345 tempest-VolumesSnapshotsTestJSON-1851455789 tempest-VolumesSnapshotsTestJSON-1851455789-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/10d02853-9b66-47ee-8f00-bfc5f8dc8436" status: 200 len: 345 microversion: 2.1 time: 0.068373 Jun 30 12:34:52.083152 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 129/257] 10.222.0.57 () {58 vars in 1244 bytes} [Thu Jun 30 12:34:52 2022] GET /compute/v2.1/os-volumes/10d02853-9b66-47ee-8f00-bfc5f8dc8436 => generated 345 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:34:52.086586 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-fcb5fa8e-fec0-4781-9913-77b939ca23f5 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:52.087260 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-fcb5fa8e-fec0-4781-9913-77b939ca23f5 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:52.088275 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-fcb5fa8e-fec0-4781-9913-77b939ca23f5 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:52.088806 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-fcb5fa8e-fec0-4781-9913-77b939ca23f5 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:52.527072 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-fcb5fa8e-fec0-4781-9913-77b939ca23f5 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:34:52.539616 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-fcb5fa8e-fec0-4781-9913-77b939ca23f5 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/99a31213-cbcb-4b2c-b07f-ab67e78a2096" status: 200 len: 1522 microversion: 2.1 time: 0.465682 Jun 30 12:34:52.541324 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 129/258] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:34:52 2022] GET /compute/v2.1/servers/99a31213-cbcb-4b2c-b07f-ab67e78a2096 => generated 1522 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:34:52.559797 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-f17dab99-6629-4183-9daa-7217f94445bc tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:52.560401 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-f17dab99-6629-4183-9daa-7217f94445bc tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 99ba3b96-6700-41e0-b2cf-ff8933b2bf94] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:34:52.570692 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-f17dab99-6629-4183-9daa-7217f94445bc tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:52.581163 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-f17dab99-6629-4183-9daa-7217f94445bc tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:52.584977 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-f17dab99-6629-4183-9daa-7217f94445bc tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:52.585593 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-f17dab99-6629-4183-9daa-7217f94445bc tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:52.611362 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-f17dab99-6629-4183-9daa-7217f94445bc tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94/ips" status: 200 len: 146 microversion: 2.1 time: 0.055653 Jun 30 12:34:52.612069 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 130/259] 10.222.0.57 () {58 vars in 1247 bytes} [Thu Jun 30 12:34:52 2022] GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94/ips => generated 146 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 12:34:53.095618 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-72b44603-6a85-4210-9d0f-158ce5496d2d tempest-VolumesSnapshotsTestJSON-1851455789 tempest-VolumesSnapshotsTestJSON-1851455789-project] Calling method '.version_select at 0x7fd0e03a1430>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:53.128204 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.wsgi [None req-72b44603-6a85-4210-9d0f-158ce5496d2d tempest-VolumesSnapshotsTestJSON-1851455789 tempest-VolumesSnapshotsTestJSON-1851455789-project] HTTP exception thrown: Volume 10d02853-9b66-47ee-8f00-bfc5f8dc8436 could not be found. Jun 30 12:34:53.130256 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-72b44603-6a85-4210-9d0f-158ce5496d2d tempest-VolumesSnapshotsTestJSON-1851455789 tempest-VolumesSnapshotsTestJSON-1851455789-project] Request method failure captured: Jun 30 12:34:53.130256 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: request: GET /compute/v2.1/os-volumes/10d02853-9b66-47ee-8f00-bfc5f8dc8436 HTTP/1.1 Jun 30 12:34:53.130256 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Accept: application/json Jun 30 12:34:53.130256 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Accept-Encoding: identity Jun 30 12:34:53.130256 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Connection: close Jun 30 12:34:53.130256 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Content-Length: 0 Jun 30 12:34:53.130256 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Content-Type: application/json Jun 30 12:34:53.130256 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Host: 10.222.0.57 Jun 30 12:34:53.130256 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Openstack-System-Scope: None Jun 30 12:34:53.130256 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: User-Agent: python-urllib3/1.26.9 Jun 30 12:34:53.130256 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Auth-Token: gAAAAABivZhYY7-UQ_meofLeuGKMR2-J7oR8ZgB07aAHkEybe9WeyqCMuELsIHXX8TuWOVAxT4TbXv1Nf2hxDmAKAoBgR4xwRUW59PG39JjquixSg5yPRn85xQWrAuP11Jkc5aWNZV422O4s8dpXi9M1G1F-W98r-v_GE30jrKPvkaD6p_l__Tw Jun 30 12:34:53.130256 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Domain-Id: None Jun 30 12:34:53.130256 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Domain-Name: None Jun 30 12:34:53.130256 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Identity-Status: Confirmed Jun 30 12:34:53.130256 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Is-Admin-Project: True Jun 30 12:34:53.130256 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Domain-Id: default Jun 30 12:34:53.130256 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Domain-Name: Default Jun 30 12:34:53.130256 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Id: 63fc82464e41424f93ceda870cd0c1dd Jun 30 12:34:53.130256 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1851455789 Jun 30 12:34:53.130256 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Role: member,reader Jun 30 12:34:53.130256 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Roles: member,reader Jun 30 12:34:53.131659 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/63fc82464e41424f93ceda870cd0c1dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/63fc82464e41424f93ceda870cd0c1dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_63fc82464e41424f93ceda870cd0c1dd", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/63fc82464e41424f93ceda870cd0c1dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 30 12:34:53.131659 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1851455789 Jun 30 12:34:53.131659 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant-Id: 63fc82464e41424f93ceda870cd0c1dd Jun 30 12:34:53.131659 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1851455789 Jun 30 12:34:53.131659 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User: tempest-VolumesSnapshotsTestJSON-1851455789-project Jun 30 12:34:53.131659 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Domain-Id: default Jun 30 12:34:53.131659 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Domain-Name: Default Jun 30 12:34:53.131659 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Id: c468edd5263442e4825dcc4711838579 Jun 30 12:34:53.131659 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1851455789-project Jun 30 12:34:53.131659 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: method: Jun 30 12:34:53.131659 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: exception: Volume 10d02853-9b66-47ee-8f00-bfc5f8dc8436 could not be found. Jun 30 12:34:53.131659 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: action_args: {'id': '10d02853-9b66-47ee-8f00-bfc5f8dc8436'} Jun 30 12:34:53.131659 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 12:34:53.132427 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:34:53.132427 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 12:34:53.132427 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 12:34:53.132427 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 30 12:34:53.132427 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 30 12:34:53.132427 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 30 12:34:53.132427 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 30 12:34:53.132427 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 30 12:34:53.132427 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 30 12:34:53.132427 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 30 12:34:53.132427 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 30 12:34:53.132427 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 12:34:53.132427 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 12:34:53.132427 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 12:34:53.132427 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 12:34:53.132427 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 10d02853-9b66-47ee-8f00-bfc5f8dc8436 could not be found. (HTTP 404) (Request-ID: req-43aa4ad8-b2f2-4cc5-a582-4e3494db653c) Jun 30 12:34:53.132427 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:34:53.132427 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:34:53.132427 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:34:53.133620 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:34:53.133620 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 30 12:34:53.133620 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 30 12:34:53.133620 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 30 12:34:53.133620 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 30 12:34:53.133620 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 30 12:34:53.133620 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 30 12:34:53.133620 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 30 12:34:53.133620 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 30 12:34:53.133620 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 12:34:53.133620 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 12:34:53.133620 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 30 12:34:53.133620 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 30 12:34:53.133620 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 30 12:34:53.133620 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 30 12:34:53.133620 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 30 12:34:53.133620 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 30 12:34:53.133620 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 30 12:34:53.133620 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 30 12:34:53.134716 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 12:34:53.134716 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 12:34:53.134716 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 12:34:53.134716 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 12:34:53.134716 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 10d02853-9b66-47ee-8f00-bfc5f8dc8436 could not be found. Jun 30 12:34:53.134716 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:34:53.134716 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:34:53.134716 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:34:53.134716 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:34:53.134716 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:34:53.134716 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:34:53.134716 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 12:34:53.134716 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 12:34:53.134716 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 30 12:34:53.134716 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 30 12:34:53.134716 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 12:34:53.134716 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 12:34:53.134716 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 30 12:34:53.134716 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 12:34:53.135936 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 10d02853-9b66-47ee-8f00-bfc5f8dc8436 could not be found. Jun 30 12:34:53.135936 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:34:53.135936 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:34:53.135936 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:34:53.135936 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:34:53.135936 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:34:53.135936 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:34:53.135936 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 12:34:53.135936 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 12:34:53.135936 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 10d02853-9b66-47ee-8f00-bfc5f8dc8436 could not be found. Jun 30 12:34:53.135936 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:34:53.140328 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-72b44603-6a85-4210-9d0f-158ce5496d2d tempest-VolumesSnapshotsTestJSON-1851455789 tempest-VolumesSnapshotsTestJSON-1851455789-project] Returning 404 to user: Volume 10d02853-9b66-47ee-8f00-bfc5f8dc8436 could not be found. {{(pid=124298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 12:34:53.141984 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-72b44603-6a85-4210-9d0f-158ce5496d2d tempest-VolumesSnapshotsTestJSON-1851455789 tempest-VolumesSnapshotsTestJSON-1851455789-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/10d02853-9b66-47ee-8f00-bfc5f8dc8436" status: 404 len: 109 microversion: 2.1 time: 0.051517 Jun 30 12:34:53.147064 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 130/260] 10.222.0.57 () {58 vars in 1244 bytes} [Thu Jun 30 12:34:53 2022] GET /compute/v2.1/os-volumes/10d02853-9b66-47ee-8f00-bfc5f8dc8436 => generated 109 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 12:34:53.152474 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-1a01ccd2-bd53-47e9-a93c-4a50b8f2ab61 tempest-VolumesSnapshotsTestJSON-1851455789 tempest-VolumesSnapshotsTestJSON-1851455789-project] Calling method '.version_select at 0x7fd0e04ffd30>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:53.190588 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.wsgi [None req-1a01ccd2-bd53-47e9-a93c-4a50b8f2ab61 tempest-VolumesSnapshotsTestJSON-1851455789 tempest-VolumesSnapshotsTestJSON-1851455789-project] HTTP exception thrown: Volume 10d02853-9b66-47ee-8f00-bfc5f8dc8436 could not be found. Jun 30 12:34:53.192947 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-1a01ccd2-bd53-47e9-a93c-4a50b8f2ab61 tempest-VolumesSnapshotsTestJSON-1851455789 tempest-VolumesSnapshotsTestJSON-1851455789-project] Request method failure captured: Jun 30 12:34:53.192947 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: request: DELETE /compute/v2.1/os-volumes/10d02853-9b66-47ee-8f00-bfc5f8dc8436 HTTP/1.1 Jun 30 12:34:53.192947 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Accept: application/json Jun 30 12:34:53.192947 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Accept-Encoding: identity Jun 30 12:34:53.192947 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Connection: close Jun 30 12:34:53.192947 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Content-Length: 0 Jun 30 12:34:53.192947 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Content-Type: application/json Jun 30 12:34:53.192947 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Host: 10.222.0.57 Jun 30 12:34:53.192947 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Openstack-System-Scope: None Jun 30 12:34:53.192947 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: User-Agent: python-urllib3/1.26.9 Jun 30 12:34:53.192947 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Auth-Token: gAAAAABivZhYY7-UQ_meofLeuGKMR2-J7oR8ZgB07aAHkEybe9WeyqCMuELsIHXX8TuWOVAxT4TbXv1Nf2hxDmAKAoBgR4xwRUW59PG39JjquixSg5yPRn85xQWrAuP11Jkc5aWNZV422O4s8dpXi9M1G1F-W98r-v_GE30jrKPvkaD6p_l__Tw Jun 30 12:34:53.192947 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Domain-Id: None Jun 30 12:34:53.192947 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Domain-Name: None Jun 30 12:34:53.192947 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Identity-Status: Confirmed Jun 30 12:34:53.192947 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Is-Admin-Project: True Jun 30 12:34:53.192947 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Project-Domain-Id: default Jun 30 12:34:53.192947 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Project-Domain-Name: Default Jun 30 12:34:53.192947 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Project-Id: 63fc82464e41424f93ceda870cd0c1dd Jun 30 12:34:53.192947 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1851455789 Jun 30 12:34:53.192947 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Role: member,reader Jun 30 12:34:53.192947 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Roles: member,reader Jun 30 12:34:53.194162 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/63fc82464e41424f93ceda870cd0c1dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/63fc82464e41424f93ceda870cd0c1dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_63fc82464e41424f93ceda870cd0c1dd", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/63fc82464e41424f93ceda870cd0c1dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 30 12:34:53.194162 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1851455789 Jun 30 12:34:53.194162 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Tenant-Id: 63fc82464e41424f93ceda870cd0c1dd Jun 30 12:34:53.194162 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1851455789 Jun 30 12:34:53.194162 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User: tempest-VolumesSnapshotsTestJSON-1851455789-project Jun 30 12:34:53.194162 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User-Domain-Id: default Jun 30 12:34:53.194162 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User-Domain-Name: Default Jun 30 12:34:53.194162 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User-Id: c468edd5263442e4825dcc4711838579 Jun 30 12:34:53.194162 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1851455789-project Jun 30 12:34:53.194162 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: method: Jun 30 12:34:53.194162 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: exception: Volume 10d02853-9b66-47ee-8f00-bfc5f8dc8436 could not be found. Jun 30 12:34:53.194162 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: action_args: {'id': '10d02853-9b66-47ee-8f00-bfc5f8dc8436'} Jun 30 12:34:53.194162 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 12:34:53.194892 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:34:53.194892 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 12:34:53.194892 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 12:34:53.194892 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 30 12:34:53.194892 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 30 12:34:53.194892 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 30 12:34:53.194892 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 30 12:34:53.194892 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 30 12:34:53.194892 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 30 12:34:53.194892 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 30 12:34:53.194892 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 30 12:34:53.194892 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 12:34:53.194892 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 12:34:53.194892 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 12:34:53.194892 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 12:34:53.194892 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 10d02853-9b66-47ee-8f00-bfc5f8dc8436 could not be found. (HTTP 404) (Request-ID: req-371fc0c2-1e2a-4c47-b770-4a5879454dcd) Jun 30 12:34:53.194892 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:34:53.194892 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:34:53.194892 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:34:53.195976 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:34:53.195976 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 30 12:34:53.195976 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 30 12:34:53.195976 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 30 12:34:53.195976 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 30 12:34:53.195976 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 30 12:34:53.195976 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 30 12:34:53.195976 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 30 12:34:53.195976 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 30 12:34:53.195976 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 12:34:53.195976 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 12:34:53.195976 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 30 12:34:53.195976 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 30 12:34:53.195976 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 30 12:34:53.195976 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 30 12:34:53.195976 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 30 12:34:53.195976 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 30 12:34:53.195976 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 30 12:34:53.195976 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 30 12:34:53.197079 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 12:34:53.197079 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 12:34:53.197079 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 12:34:53.197079 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 12:34:53.197079 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 10d02853-9b66-47ee-8f00-bfc5f8dc8436 could not be found. Jun 30 12:34:53.197079 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:34:53.197079 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:34:53.197079 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:34:53.197079 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:34:53.197079 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:34:53.197079 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:34:53.197079 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 12:34:53.197079 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 12:34:53.197079 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 30 12:34:53.197079 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 30 12:34:53.197079 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 12:34:53.197079 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 12:34:53.197079 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 30 12:34:53.197079 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 12:34:53.198108 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 10d02853-9b66-47ee-8f00-bfc5f8dc8436 could not be found. Jun 30 12:34:53.198108 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:34:53.198108 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:34:53.198108 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:34:53.198108 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:34:53.198108 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:34:53.198108 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:34:53.198108 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 12:34:53.198108 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 12:34:53.198108 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 10d02853-9b66-47ee-8f00-bfc5f8dc8436 could not be found. Jun 30 12:34:53.198108 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:34:53.198108 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-1a01ccd2-bd53-47e9-a93c-4a50b8f2ab61 tempest-VolumesSnapshotsTestJSON-1851455789 tempest-VolumesSnapshotsTestJSON-1851455789-project] Returning 404 to user: Volume 10d02853-9b66-47ee-8f00-bfc5f8dc8436 could not be found. {{(pid=124297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 12:34:53.198108 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-1a01ccd2-bd53-47e9-a93c-4a50b8f2ab61 tempest-VolumesSnapshotsTestJSON-1851455789 tempest-VolumesSnapshotsTestJSON-1851455789-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/10d02853-9b66-47ee-8f00-bfc5f8dc8436" status: 404 len: 109 microversion: 2.1 time: 0.046954 Jun 30 12:34:53.199709 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 131/261] 10.222.0.57 () {58 vars in 1247 bytes} [Thu Jun 30 12:34:53 2022] DELETE /compute/v2.1/os-volumes/10d02853-9b66-47ee-8f00-bfc5f8dc8436 => generated 109 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 12:34:53.204380 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-a2294cb1-7f69-4850-b615-c9e24f1fff29 tempest-VolumesSnapshotsTestJSON-1851455789 tempest-VolumesSnapshotsTestJSON-1851455789-project] Calling method '.version_select at 0x7fd0e03f4310>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:53.241550 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.wsgi [None req-a2294cb1-7f69-4850-b615-c9e24f1fff29 tempest-VolumesSnapshotsTestJSON-1851455789 tempest-VolumesSnapshotsTestJSON-1851455789-project] HTTP exception thrown: Volume 10d02853-9b66-47ee-8f00-bfc5f8dc8436 could not be found. Jun 30 12:34:53.243505 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-a2294cb1-7f69-4850-b615-c9e24f1fff29 tempest-VolumesSnapshotsTestJSON-1851455789 tempest-VolumesSnapshotsTestJSON-1851455789-project] Request method failure captured: Jun 30 12:34:53.243505 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: request: GET /compute/v2.1/os-volumes/10d02853-9b66-47ee-8f00-bfc5f8dc8436 HTTP/1.1 Jun 30 12:34:53.243505 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Accept: application/json Jun 30 12:34:53.243505 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Accept-Encoding: identity Jun 30 12:34:53.243505 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Connection: close Jun 30 12:34:53.243505 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Content-Length: 0 Jun 30 12:34:53.243505 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Content-Type: application/json Jun 30 12:34:53.243505 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Host: 10.222.0.57 Jun 30 12:34:53.243505 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Openstack-System-Scope: None Jun 30 12:34:53.243505 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: User-Agent: python-urllib3/1.26.9 Jun 30 12:34:53.243505 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Auth-Token: gAAAAABivZhYY7-UQ_meofLeuGKMR2-J7oR8ZgB07aAHkEybe9WeyqCMuELsIHXX8TuWOVAxT4TbXv1Nf2hxDmAKAoBgR4xwRUW59PG39JjquixSg5yPRn85xQWrAuP11Jkc5aWNZV422O4s8dpXi9M1G1F-W98r-v_GE30jrKPvkaD6p_l__Tw Jun 30 12:34:53.243505 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Domain-Id: None Jun 30 12:34:53.243505 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Domain-Name: None Jun 30 12:34:53.243505 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Identity-Status: Confirmed Jun 30 12:34:53.243505 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Is-Admin-Project: True Jun 30 12:34:53.243505 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Domain-Id: default Jun 30 12:34:53.243505 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Domain-Name: Default Jun 30 12:34:53.243505 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Id: 63fc82464e41424f93ceda870cd0c1dd Jun 30 12:34:53.243505 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1851455789 Jun 30 12:34:53.243505 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Role: member,reader Jun 30 12:34:53.243505 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Roles: member,reader Jun 30 12:34:53.245164 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/63fc82464e41424f93ceda870cd0c1dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/63fc82464e41424f93ceda870cd0c1dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_63fc82464e41424f93ceda870cd0c1dd", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/63fc82464e41424f93ceda870cd0c1dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 30 12:34:53.245164 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1851455789 Jun 30 12:34:53.245164 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant-Id: 63fc82464e41424f93ceda870cd0c1dd Jun 30 12:34:53.245164 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1851455789 Jun 30 12:34:53.245164 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User: tempest-VolumesSnapshotsTestJSON-1851455789-project Jun 30 12:34:53.245164 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Domain-Id: default Jun 30 12:34:53.245164 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Domain-Name: Default Jun 30 12:34:53.245164 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Id: c468edd5263442e4825dcc4711838579 Jun 30 12:34:53.245164 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1851455789-project Jun 30 12:34:53.245164 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: method: Jun 30 12:34:53.245164 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: exception: Volume 10d02853-9b66-47ee-8f00-bfc5f8dc8436 could not be found. Jun 30 12:34:53.245164 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: action_args: {'id': '10d02853-9b66-47ee-8f00-bfc5f8dc8436'} Jun 30 12:34:53.245164 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 12:34:53.245918 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:34:53.245918 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 12:34:53.245918 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 12:34:53.245918 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 30 12:34:53.245918 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 30 12:34:53.245918 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 30 12:34:53.245918 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 30 12:34:53.245918 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 30 12:34:53.245918 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 30 12:34:53.245918 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 30 12:34:53.245918 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 30 12:34:53.245918 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 12:34:53.245918 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 12:34:53.245918 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 12:34:53.245918 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 12:34:53.245918 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 10d02853-9b66-47ee-8f00-bfc5f8dc8436 could not be found. (HTTP 404) (Request-ID: req-1c1f83de-23e2-489f-92b1-2640a0ce6567) Jun 30 12:34:53.245918 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:34:53.245918 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:34:53.245918 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:34:53.247172 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:34:53.247172 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 30 12:34:53.247172 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 30 12:34:53.247172 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 30 12:34:53.247172 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 30 12:34:53.247172 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 30 12:34:53.247172 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 30 12:34:53.247172 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 30 12:34:53.247172 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 30 12:34:53.247172 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 12:34:53.247172 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 12:34:53.247172 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 30 12:34:53.247172 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 30 12:34:53.247172 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 30 12:34:53.247172 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 30 12:34:53.247172 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 30 12:34:53.247172 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 30 12:34:53.247172 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 30 12:34:53.247172 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 30 12:34:53.248269 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 12:34:53.248269 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 12:34:53.248269 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 12:34:53.248269 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 12:34:53.248269 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 10d02853-9b66-47ee-8f00-bfc5f8dc8436 could not be found. Jun 30 12:34:53.248269 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:34:53.248269 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:34:53.248269 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:34:53.248269 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:34:53.248269 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:34:53.248269 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:34:53.248269 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 12:34:53.248269 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 12:34:53.248269 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 30 12:34:53.248269 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 30 12:34:53.248269 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 12:34:53.248269 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 12:34:53.248269 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 30 12:34:53.248269 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 12:34:53.250518 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 10d02853-9b66-47ee-8f00-bfc5f8dc8436 could not be found. Jun 30 12:34:53.250518 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:34:53.250518 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:34:53.250518 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:34:53.250518 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:34:53.250518 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:34:53.250518 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:34:53.250518 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 12:34:53.250518 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 12:34:53.250518 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 10d02853-9b66-47ee-8f00-bfc5f8dc8436 could not be found. Jun 30 12:34:53.250518 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:34:53.250518 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-a2294cb1-7f69-4850-b615-c9e24f1fff29 tempest-VolumesSnapshotsTestJSON-1851455789 tempest-VolumesSnapshotsTestJSON-1851455789-project] Returning 404 to user: Volume 10d02853-9b66-47ee-8f00-bfc5f8dc8436 could not be found. {{(pid=124298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 12:34:53.250518 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-a2294cb1-7f69-4850-b615-c9e24f1fff29 tempest-VolumesSnapshotsTestJSON-1851455789 tempest-VolumesSnapshotsTestJSON-1851455789-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/10d02853-9b66-47ee-8f00-bfc5f8dc8436" status: 404 len: 109 microversion: 2.1 time: 0.044312 Jun 30 12:34:53.250518 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 131/262] 10.222.0.57 () {58 vars in 1244 bytes} [Thu Jun 30 12:34:53 2022] GET /compute/v2.1/os-volumes/10d02853-9b66-47ee-8f00-bfc5f8dc8436 => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 30 12:34:53.559696 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-9832801c-b7dd-4b00-8746-44c4423c0f78 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:53.560287 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-9832801c-b7dd-4b00-8746-44c4423c0f78 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: 99a31213-cbcb-4b2c-b07f-ab67e78a2096] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:34:53.575322 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-9832801c-b7dd-4b00-8746-44c4423c0f78 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:53.575774 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-9832801c-b7dd-4b00-8746-44c4423c0f78 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:53.576589 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-9832801c-b7dd-4b00-8746-44c4423c0f78 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:53.579226 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-9832801c-b7dd-4b00-8746-44c4423c0f78 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:53.848866 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-9832801c-b7dd-4b00-8746-44c4423c0f78 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:34:53.861316 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-9832801c-b7dd-4b00-8746-44c4423c0f78 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/99a31213-cbcb-4b2c-b07f-ab67e78a2096" status: 200 len: 1522 microversion: 2.1 time: 0.305184 Jun 30 12:34:53.861998 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 132/263] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:34:53 2022] GET /compute/v2.1/servers/99a31213-cbcb-4b2c-b07f-ab67e78a2096 => generated 1522 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 12:34:54.883285 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-2b4163db-6102-4d3d-ac62-f8e2102c8094 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:54.884645 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-2b4163db-6102-4d3d-ac62-f8e2102c8094 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: 99a31213-cbcb-4b2c-b07f-ab67e78a2096] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:34:54.905542 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-2b4163db-6102-4d3d-ac62-f8e2102c8094 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:54.906893 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-2b4163db-6102-4d3d-ac62-f8e2102c8094 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:54.911845 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-2b4163db-6102-4d3d-ac62-f8e2102c8094 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:54.912306 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-2b4163db-6102-4d3d-ac62-f8e2102c8094 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:54.923366 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG dbcounter [-] [124298] Writing DB stats nova_cell1:SELECT=99 {{(pid=124298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:34:55.112492 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-2b4163db-6102-4d3d-ac62-f8e2102c8094 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:34:55.122635 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-2b4163db-6102-4d3d-ac62-f8e2102c8094 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/99a31213-cbcb-4b2c-b07f-ab67e78a2096" status: 200 len: 1522 microversion: 2.1 time: 0.243887 Jun 30 12:34:55.123264 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 132/264] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:34:54 2022] GET /compute/v2.1/servers/99a31213-cbcb-4b2c-b07f-ab67e78a2096 => generated 1522 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 12:34:55.566410 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-1ab6f6ff-7edd-4b17-a351-d051d7cc83f3 tempest-VolumesGetTestJSON-198940552 tempest-VolumesGetTestJSON-198940552-project] Action: 'create', calling method: .version_select at 0x7fd0e04ff4c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-391502875", "metadata": {"Type": "work"}}} {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:34:55.746780 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-d18bb29a-97db-41ce-a3f8-83eeba216cc9 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Action: 'create', calling method: .version_select at 0x7fd0e03a1af0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1683758013", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH35rJoUQ+FjdL+32lSJRlyjKaOtQoTihtKstE4lN1DZqwaoC7VGcWffw/RIq2fLkyRxOXdATwAD//Evx4KLVxHZJFlLjjzBsJifBKox8PtzdoGU/O1YSEJOx547e18djQ=="}} {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:34:55.767240 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.quota [None req-d18bb29a-97db-41ce-a3f8-83eeba216cc9 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Getting quotas for project 4a42d5073b0f4e4c857d794aa8d30393. Resources: {'key_pairs'} {{(pid=124298) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 12:34:55.772148 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.quota [None req-d18bb29a-97db-41ce-a3f8-83eeba216cc9 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Getting quotas for user 1fc65fea19f94fd18d83ad8ce3bbb476 and project 4a42d5073b0f4e4c857d794aa8d30393. Resources: {'key_pairs'} {{(pid=124298) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 12:34:55.831341 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-d18bb29a-97db-41ce-a3f8-83eeba216cc9 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.088237 Jun 30 12:34:55.832492 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 133/265] 10.222.0.57 () {60 vars in 1158 bytes} [Thu Jun 30 12:34:55 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:34:55.959969 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-66917b6a-a8e7-424d-9407-566c59f5442e tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1813418703", "imageRef": "47989212-bfd9-478b-97a5-9f2a82dc549a", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1683758013", "networks": [{"uuid": "d1c213af-1d4e-47f6-86d8-837c98085024"}]}} {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:34:56.038372 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.network.neutron [None req-66917b6a-a8e7-424d-9407-566c59f5442e tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] validate_networks() for [('d1c213af-1d4e-47f6-86d8-837c98085024', None, None, None, None, None)] {{(pid=124298) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 12:34:56.140368 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-1ab6f6ff-7edd-4b17-a351-d051d7cc83f3 tempest-VolumesGetTestJSON-198940552 tempest-VolumesGetTestJSON-198940552-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.855850 Jun 30 12:34:56.141115 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 133/266] 10.222.0.57 () {60 vars in 1155 bytes} [Thu Jun 30 12:34:55 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 857 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jun 30 12:34:56.147196 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-9b0a0498-7f26-4899-9666-a185d9766fea tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:56.147196 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-9b0a0498-7f26-4899-9666-a185d9766fea tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: 99a31213-cbcb-4b2c-b07f-ab67e78a2096] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:34:56.173733 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-9b0a0498-7f26-4899-9666-a185d9766fea tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:56.174224 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-9b0a0498-7f26-4899-9666-a185d9766fea tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:56.177493 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-9b0a0498-7f26-4899-9666-a185d9766fea tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:56.177493 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-9b0a0498-7f26-4899-9666-a185d9766fea tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:56.396101 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-9b0a0498-7f26-4899-9666-a185d9766fea tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:34:56.406577 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-9b0a0498-7f26-4899-9666-a185d9766fea tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/99a31213-cbcb-4b2c-b07f-ab67e78a2096" status: 200 len: 1522 microversion: 2.1 time: 0.264258 Jun 30 12:34:56.407486 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 134/267] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:34:56 2022] GET /compute/v2.1/servers/99a31213-cbcb-4b2c-b07f-ab67e78a2096 => generated 1522 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:34:56.424133 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-7877e31f-1cc4-4d35-8e89-ffa1775bb2be tempest-VolumesGetTestJSON-198940552 tempest-VolumesGetTestJSON-198940552-project] Calling method '.version_select at 0x7fd0e102a1f0>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:56.505514 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-7877e31f-1cc4-4d35-8e89-ffa1775bb2be tempest-VolumesGetTestJSON-198940552 tempest-VolumesGetTestJSON-198940552-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/ef9119d0-7142-481b-8842-ef04a4405b40" status: 200 len: 352 microversion: 2.1 time: 0.096240 Jun 30 12:34:56.506378 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 135/268] 10.222.0.57 () {58 vars in 1244 bytes} [Thu Jun 30 12:34:56 2022] GET /compute/v2.1/os-volumes/ef9119d0-7142-481b-8842-ef04a4405b40 => generated 352 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:34:56.743579 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.virt.hardware [None req-66917b6a-a8e7-424d-9407-566c59f5442e tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Flavor limits 0:0:0 {{(pid=124298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 12:34:56.744146 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.virt.hardware [None req-66917b6a-a8e7-424d-9407-566c59f5442e tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Image limits 0:0:0 {{(pid=124298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 12:34:56.744647 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.virt.hardware [None req-66917b6a-a8e7-424d-9407-566c59f5442e tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Flavor pref 0:0:0 {{(pid=124298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 12:34:56.745139 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.virt.hardware [None req-66917b6a-a8e7-424d-9407-566c59f5442e tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Image pref 0:0:0 {{(pid=124298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 12:34:56.745545 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.virt.hardware [None req-66917b6a-a8e7-424d-9407-566c59f5442e tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 12:34:56.755557 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-66917b6a-a8e7-424d-9407-566c59f5442e tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:56.755983 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-66917b6a-a8e7-424d-9407-566c59f5442e tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:56.756750 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-66917b6a-a8e7-424d-9407-566c59f5442e tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:56.757182 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-66917b6a-a8e7-424d-9407-566c59f5442e tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:56.774221 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.quota [None req-66917b6a-a8e7-424d-9407-566c59f5442e tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Getting quotas for project 4a42d5073b0f4e4c857d794aa8d30393. Resources: {'cores', 'ram', 'instances'} {{(pid=124298) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 12:34:56.778221 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.quota [None req-66917b6a-a8e7-424d-9407-566c59f5442e tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Getting quotas for user 1fc65fea19f94fd18d83ad8ce3bbb476 and project 4a42d5073b0f4e4c857d794aa8d30393. Resources: {'cores', 'ram', 'instances'} {{(pid=124298) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 12:34:56.789983 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-66917b6a-a8e7-424d-9407-566c59f5442e tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Going to run 1 instances... {{(pid=124298) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 12:34:56.792176 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-66917b6a-a8e7-424d-9407-566c59f5442e tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] [instance: d328d6c1-d49a-48c5-a26e-1ab70019f6df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='47989212-bfd9-478b-97a5-9f2a82dc549a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124298) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 12:34:56.842475 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-66917b6a-a8e7-424d-9407-566c59f5442e tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.888832 Jun 30 12:34:56.843083 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 134/269] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 30 12:34:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 890 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 12:34:56.852895 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-b2a0f8fc-1b50-4307-b502-f43333043fcf tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:56.853514 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-b2a0f8fc-1b50-4307-b502-f43333043fcf tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] [instance: d328d6c1-d49a-48c5-a26e-1ab70019f6df] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:34:56.912706 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-b2a0f8fc-1b50-4307-b502-f43333043fcf tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc65fea19f94fd18d83ad8ce3bbb476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a42d5073b0f4e4c857d794aa8d30393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:34:56.930683 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-b2a0f8fc-1b50-4307-b502-f43333043fcf tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] 10.222.0.57 "GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df" status: 200 len: 1259 microversion: 2.1 time: 0.081465 Jun 30 12:34:56.931501 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 136/270] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:34:56 2022] GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df => generated 1259 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:34:57.426108 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-2d9c821b-bc18-44c9-a95f-2b4f9c803b82 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:57.427382 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-2d9c821b-bc18-44c9-a95f-2b4f9c803b82 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: 99a31213-cbcb-4b2c-b07f-ab67e78a2096] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:34:57.433826 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-2d9c821b-bc18-44c9-a95f-2b4f9c803b82 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:57.434271 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-2d9c821b-bc18-44c9-a95f-2b4f9c803b82 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:57.435038 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-2d9c821b-bc18-44c9-a95f-2b4f9c803b82 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:57.435504 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-2d9c821b-bc18-44c9-a95f-2b4f9c803b82 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:57.518855 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-b52fe989-9c58-492e-a72f-a72ea6071cae tempest-VolumesGetTestJSON-198940552 tempest-VolumesGetTestJSON-198940552-project] Calling method '.version_select at 0x7fd0e0343ee0>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:57.572672 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-b52fe989-9c58-492e-a72f-a72ea6071cae tempest-VolumesGetTestJSON-198940552 tempest-VolumesGetTestJSON-198940552-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/ef9119d0-7142-481b-8842-ef04a4405b40" status: 200 len: 353 microversion: 2.1 time: 0.058265 Jun 30 12:34:57.579471 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 137/271] 10.222.0.57 () {58 vars in 1244 bytes} [Thu Jun 30 12:34:57 2022] GET /compute/v2.1/os-volumes/ef9119d0-7142-481b-8842-ef04a4405b40 => generated 353 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 12:34:57.584394 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-ad15013b-7c3b-4067-aa60-a4eab1f379b1 tempest-VolumesGetTestJSON-198940552 tempest-VolumesGetTestJSON-198940552-project] Calling method '.version_select at 0x7fd0e0551ee0>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:57.591840 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-2d9c821b-bc18-44c9-a95f-2b4f9c803b82 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:34:57.603603 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-2d9c821b-bc18-44c9-a95f-2b4f9c803b82 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/99a31213-cbcb-4b2c-b07f-ab67e78a2096" status: 200 len: 1522 microversion: 2.1 time: 0.182012 Jun 30 12:34:57.604268 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 135/272] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:34:57 2022] GET /compute/v2.1/servers/99a31213-cbcb-4b2c-b07f-ab67e78a2096 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:34:57.634214 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-ad15013b-7c3b-4067-aa60-a4eab1f379b1 tempest-VolumesGetTestJSON-198940552 tempest-VolumesGetTestJSON-198940552-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/ef9119d0-7142-481b-8842-ef04a4405b40" status: 200 len: 353 microversion: 2.1 time: 0.053522 Jun 30 12:34:57.634893 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 138/273] 10.222.0.57 () {58 vars in 1244 bytes} [Thu Jun 30 12:34:57 2022] GET /compute/v2.1/os-volumes/ef9119d0-7142-481b-8842-ef04a4405b40 => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 12:34:57.635731 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-639c2a62-4e1c-48c6-96f2-efae274a266b tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "70be5a72-4440-4a1a-bbcc-cd138178ae42"}} {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:34:57.637084 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-639c2a62-4e1c-48c6-96f2-efae274a266b tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 99ba3b96-6700-41e0-b2cf-ff8933b2bf94] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:34:57.644099 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-639c2a62-4e1c-48c6-96f2-efae274a266b tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:57.644561 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-639c2a62-4e1c-48c6-96f2-efae274a266b tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:57.645353 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-639c2a62-4e1c-48c6-96f2-efae274a266b tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:57.645789 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-639c2a62-4e1c-48c6-96f2-efae274a266b tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:57.651251 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-b7763afb-e5da-4add-bd87-283e2736d8ac tempest-VolumesGetTestJSON-198940552 tempest-VolumesGetTestJSON-198940552-project] Calling method '.version_select at 0x7fd0e05f4940>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:57.714332 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-b7763afb-e5da-4add-bd87-283e2736d8ac tempest-VolumesGetTestJSON-198940552 tempest-VolumesGetTestJSON-198940552-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/ef9119d0-7142-481b-8842-ef04a4405b40" status: 202 len: 0 microversion: 2.1 time: 0.066751 Jun 30 12:34:57.718278 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 139/274] 10.222.0.57 () {58 vars in 1247 bytes} [Thu Jun 30 12:34:57 2022] DELETE /compute/v2.1/os-volumes/ef9119d0-7142-481b-8842-ef04a4405b40 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 30 12:34:57.724925 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-0ffb6700-0e4a-4122-801e-bcecb913e2ec tempest-VolumesGetTestJSON-198940552 tempest-VolumesGetTestJSON-198940552-project] Calling method '.version_select at 0x7fd0e0551700>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:57.777004 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-0ffb6700-0e4a-4122-801e-bcecb913e2ec tempest-VolumesGetTestJSON-198940552 tempest-VolumesGetTestJSON-198940552-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/ef9119d0-7142-481b-8842-ef04a4405b40" status: 200 len: 352 microversion: 2.1 time: 0.056833 Jun 30 12:34:57.778057 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 140/275] 10.222.0.57 () {58 vars in 1244 bytes} [Thu Jun 30 12:34:57 2022] GET /compute/v2.1/os-volumes/ef9119d0-7142-481b-8842-ef04a4405b40 => generated 352 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 12:34:57.949426 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-ff7c265e-be62-438f-b0e1-db5d957cc176 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:57.950142 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-ff7c265e-be62-438f-b0e1-db5d957cc176 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] [instance: d328d6c1-d49a-48c5-a26e-1ab70019f6df] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:34:57.959406 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-ff7c265e-be62-438f-b0e1-db5d957cc176 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:57.959953 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-ff7c265e-be62-438f-b0e1-db5d957cc176 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:57.961133 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-ff7c265e-be62-438f-b0e1-db5d957cc176 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:57.961594 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-ff7c265e-be62-438f-b0e1-db5d957cc176 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:58.035552 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-ff7c265e-be62-438f-b0e1-db5d957cc176 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc65fea19f94fd18d83ad8ce3bbb476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a42d5073b0f4e4c857d794aa8d30393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:34:58.049966 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-ff7c265e-be62-438f-b0e1-db5d957cc176 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] 10.222.0.57 "GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df" status: 200 len: 1319 microversion: 2.1 time: 0.104180 Jun 30 12:34:58.051469 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 141/276] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:34:57 2022] GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df => generated 1319 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 12:34:58.114722 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-639c2a62-4e1c-48c6-96f2-efae274a266b tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "POST /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.482995 Jun 30 12:34:58.116560 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 136/277] 10.222.0.57 () {60 vars in 1322 bytes} [Thu Jun 30 12:34:57 2022] POST /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94/os-volume_attachments => generated 194 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 12:34:58.623811 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-4d45838f-3b29-40ee-8d39-330b4889736d tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:58.624520 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-4d45838f-3b29-40ee-8d39-330b4889736d tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: 99a31213-cbcb-4b2c-b07f-ab67e78a2096] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:34:58.636424 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-4d45838f-3b29-40ee-8d39-330b4889736d tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:58.636907 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-4d45838f-3b29-40ee-8d39-330b4889736d tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:58.637694 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-4d45838f-3b29-40ee-8d39-330b4889736d tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:58.638474 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-4d45838f-3b29-40ee-8d39-330b4889736d tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:58.792230 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-98898e64-1242-49c2-a081-58a985361ea0 tempest-VolumesGetTestJSON-198940552 tempest-VolumesGetTestJSON-198940552-project] Calling method '.version_select at 0x7fd0e039e820>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:58.856305 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-4d45838f-3b29-40ee-8d39-330b4889736d tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:34:58.857511 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.wsgi [None req-98898e64-1242-49c2-a081-58a985361ea0 tempest-VolumesGetTestJSON-198940552 tempest-VolumesGetTestJSON-198940552-project] HTTP exception thrown: Volume ef9119d0-7142-481b-8842-ef04a4405b40 could not be found. Jun 30 12:34:58.859950 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-98898e64-1242-49c2-a081-58a985361ea0 tempest-VolumesGetTestJSON-198940552 tempest-VolumesGetTestJSON-198940552-project] Request method failure captured: Jun 30 12:34:58.859950 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: request: GET /compute/v2.1/os-volumes/ef9119d0-7142-481b-8842-ef04a4405b40 HTTP/1.1 Jun 30 12:34:58.859950 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Accept: application/json Jun 30 12:34:58.859950 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Accept-Encoding: identity Jun 30 12:34:58.859950 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Connection: close Jun 30 12:34:58.859950 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Content-Length: 0 Jun 30 12:34:58.859950 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Content-Type: application/json Jun 30 12:34:58.859950 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Host: 10.222.0.57 Jun 30 12:34:58.859950 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Openstack-System-Scope: None Jun 30 12:34:58.859950 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: User-Agent: python-urllib3/1.26.9 Jun 30 12:34:58.859950 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Auth-Token: gAAAAABivZhvcpI3rVlsp9gJlDEbpeKAi88URip4yHKVaTGbRBKEQ6brP_hk2ydOxxnSvpLMUjIjiiwk6ApJpeUP9-b7VV2h8saPVVsx0xD2qMntgftNZjSNkBgwdYvsAiALQ10vz4ybZ9REXMb1ooLr3rZeJhWYHkPFVZDM6T4fw1HhLBTx_jM Jun 30 12:34:58.859950 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Domain-Id: None Jun 30 12:34:58.859950 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Domain-Name: None Jun 30 12:34:58.859950 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Identity-Status: Confirmed Jun 30 12:34:58.859950 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Is-Admin-Project: True Jun 30 12:34:58.859950 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Domain-Id: default Jun 30 12:34:58.859950 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Domain-Name: Default Jun 30 12:34:58.859950 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Id: bf03ddd8a2004a0186d6286195ccca43 Jun 30 12:34:58.859950 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Name: tempest-VolumesGetTestJSON-198940552 Jun 30 12:34:58.859950 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Role: member,reader Jun 30 12:34:58.859950 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Roles: member,reader Jun 30 12:34:58.861848 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/bf03ddd8a2004a0186d6286195ccca43"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/bf03ddd8a2004a0186d6286195ccca43"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_bf03ddd8a2004a0186d6286195ccca43", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/bf03ddd8a2004a0186d6286195ccca43"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 30 12:34:58.861848 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant: tempest-VolumesGetTestJSON-198940552 Jun 30 12:34:58.861848 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant-Id: bf03ddd8a2004a0186d6286195ccca43 Jun 30 12:34:58.861848 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant-Name: tempest-VolumesGetTestJSON-198940552 Jun 30 12:34:58.861848 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User: tempest-VolumesGetTestJSON-198940552-project Jun 30 12:34:58.861848 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Domain-Id: default Jun 30 12:34:58.861848 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Domain-Name: Default Jun 30 12:34:58.861848 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Id: 1aceb8120f9140eeb40bfa8e57d0c539 Jun 30 12:34:58.861848 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Name: tempest-VolumesGetTestJSON-198940552-project Jun 30 12:34:58.861848 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: method: Jun 30 12:34:58.861848 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: exception: Volume ef9119d0-7142-481b-8842-ef04a4405b40 could not be found. Jun 30 12:34:58.861848 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: action_args: {'id': 'ef9119d0-7142-481b-8842-ef04a4405b40'} Jun 30 12:34:58.861848 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 12:34:58.862936 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:34:58.862936 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 12:34:58.862936 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 12:34:58.862936 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 30 12:34:58.862936 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 30 12:34:58.862936 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 30 12:34:58.862936 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 30 12:34:58.862936 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 30 12:34:58.862936 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 30 12:34:58.862936 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 30 12:34:58.862936 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 30 12:34:58.862936 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 12:34:58.862936 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 12:34:58.862936 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 12:34:58.862936 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 12:34:58.862936 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ef9119d0-7142-481b-8842-ef04a4405b40 could not be found. (HTTP 404) (Request-ID: req-ae2a2640-b988-43e9-9afd-d2ddf99c2330) Jun 30 12:34:58.862936 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:34:58.862936 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:34:58.862936 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:34:58.864319 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:34:58.864319 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 30 12:34:58.864319 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 30 12:34:58.864319 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 30 12:34:58.864319 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 30 12:34:58.864319 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 30 12:34:58.864319 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 30 12:34:58.864319 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 30 12:34:58.864319 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 30 12:34:58.864319 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 12:34:58.864319 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 12:34:58.864319 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 30 12:34:58.864319 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 30 12:34:58.864319 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 30 12:34:58.864319 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 30 12:34:58.864319 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 30 12:34:58.864319 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 30 12:34:58.864319 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 30 12:34:58.864319 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 30 12:34:58.865608 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 12:34:58.865608 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 12:34:58.865608 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 12:34:58.865608 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 12:34:58.865608 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ef9119d0-7142-481b-8842-ef04a4405b40 could not be found. Jun 30 12:34:58.865608 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:34:58.865608 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:34:58.865608 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:34:58.865608 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:34:58.865608 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:34:58.865608 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:34:58.865608 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 12:34:58.865608 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 12:34:58.865608 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 30 12:34:58.865608 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 30 12:34:58.865608 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 12:34:58.865608 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 12:34:58.865608 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 30 12:34:58.865608 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 12:34:58.868361 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ef9119d0-7142-481b-8842-ef04a4405b40 could not be found. Jun 30 12:34:58.868361 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:34:58.868361 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:34:58.868361 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:34:58.868361 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:34:58.868361 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:34:58.868361 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:34:58.868361 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 12:34:58.868361 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 12:34:58.868361 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ef9119d0-7142-481b-8842-ef04a4405b40 could not be found. Jun 30 12:34:58.868361 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:34:58.868361 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-98898e64-1242-49c2-a081-58a985361ea0 tempest-VolumesGetTestJSON-198940552 tempest-VolumesGetTestJSON-198940552-project] Returning 404 to user: Volume ef9119d0-7142-481b-8842-ef04a4405b40 could not be found. {{(pid=124298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 12:34:58.868361 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-98898e64-1242-49c2-a081-58a985361ea0 tempest-VolumesGetTestJSON-198940552 tempest-VolumesGetTestJSON-198940552-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/ef9119d0-7142-481b-8842-ef04a4405b40" status: 404 len: 109 microversion: 2.1 time: 0.073753 Jun 30 12:34:58.868361 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 137/278] 10.222.0.57 () {58 vars in 1244 bytes} [Thu Jun 30 12:34:58 2022] GET /compute/v2.1/os-volumes/ef9119d0-7142-481b-8842-ef04a4405b40 => generated 109 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 12:34:58.894044 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-4d45838f-3b29-40ee-8d39-330b4889736d tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/99a31213-cbcb-4b2c-b07f-ab67e78a2096" status: 200 len: 1522 microversion: 2.1 time: 0.276207 Jun 30 12:34:58.897665 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 142/279] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:34:58 2022] GET /compute/v2.1/servers/99a31213-cbcb-4b2c-b07f-ab67e78a2096 => generated 1522 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:34:59.072383 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-ead99fdc-b399-4bf3-a05b-369489131530 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:59.073701 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-ead99fdc-b399-4bf3-a05b-369489131530 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] [instance: d328d6c1-d49a-48c5-a26e-1ab70019f6df] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:34:59.088392 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-ead99fdc-b399-4bf3-a05b-369489131530 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:59.090231 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-ead99fdc-b399-4bf3-a05b-369489131530 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:59.091426 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-ead99fdc-b399-4bf3-a05b-369489131530 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:59.092210 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-ead99fdc-b399-4bf3-a05b-369489131530 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:59.606372 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-ead99fdc-b399-4bf3-a05b-369489131530 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc65fea19f94fd18d83ad8ce3bbb476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a42d5073b0f4e4c857d794aa8d30393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:34:59.617801 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-ead99fdc-b399-4bf3-a05b-369489131530 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] 10.222.0.57 "GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df" status: 200 len: 1359 microversion: 2.1 time: 0.551789 Jun 30 12:34:59.636248 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 138/280] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:34:59 2022] GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df => generated 1359 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:34:59.914781 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-dc2f3619-a14d-417d-87d4-bb972bf50438 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:34:59.915385 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-dc2f3619-a14d-417d-87d4-bb972bf50438 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: 99a31213-cbcb-4b2c-b07f-ab67e78a2096] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:34:59.924462 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-dc2f3619-a14d-417d-87d4-bb972bf50438 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:59.925335 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-dc2f3619-a14d-417d-87d4-bb972bf50438 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:34:59.926195 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-dc2f3619-a14d-417d-87d4-bb972bf50438 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:34:59.926916 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-dc2f3619-a14d-417d-87d4-bb972bf50438 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:00.261576 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-dc2f3619-a14d-417d-87d4-bb972bf50438 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:35:00.277087 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-dc2f3619-a14d-417d-87d4-bb972bf50438 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/99a31213-cbcb-4b2c-b07f-ab67e78a2096" status: 200 len: 1522 microversion: 2.1 time: 0.366865 Jun 30 12:35:00.277956 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 143/281] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:34:59 2022] GET /compute/v2.1/servers/99a31213-cbcb-4b2c-b07f-ab67e78a2096 => generated 1522 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:35:00.649356 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-8da6b0da-3495-4678-bab4-abd18a182624 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:35:00.650717 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-8da6b0da-3495-4678-bab4-abd18a182624 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] [instance: d328d6c1-d49a-48c5-a26e-1ab70019f6df] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:35:00.663353 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-8da6b0da-3495-4678-bab4-abd18a182624 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:00.664439 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-8da6b0da-3495-4678-bab4-abd18a182624 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:00.665568 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-8da6b0da-3495-4678-bab4-abd18a182624 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:00.668465 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-8da6b0da-3495-4678-bab4-abd18a182624 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:00.940131 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [req-fa9d4780-9808-486f-9486-1d97f75b1ebd req-4d6f4e93-498e-4f04-b9bf-86acd665f336 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d328d6c1-d49a-48c5-a26e-1ab70019f6df", "tag": "a04c1ee8-5a15-46b6-87ec-288a776bc842"}]} {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:35:01.006369 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [req-fa9d4780-9808-486f-9486-1d97f75b1ebd req-4d6f4e93-498e-4f04-b9bf-86acd665f336 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:01.008902 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [req-fa9d4780-9808-486f-9486-1d97f75b1ebd req-4d6f4e93-498e-4f04-b9bf-86acd665f336 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:01.075827 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.compute.server_external_events [req-fa9d4780-9808-486f-9486-1d97f75b1ebd req-4d6f4e93-498e-4f04-b9bf-86acd665f336 service nova] Creating event network-changed:a04c1ee8-5a15-46b6-87ec-288a776bc842 for instance d328d6c1-d49a-48c5-a26e-1ab70019f6df on hv-cinder-84614 Jun 30 12:35:01.118718 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [req-fa9d4780-9808-486f-9486-1d97f75b1ebd req-4d6f4e93-498e-4f04-b9bf-86acd665f336 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.188637 Jun 30 12:35:01.125476 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 144/282] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 30 12:35:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 12:35:01.297738 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-4a1dd4f3-0bcc-4a25-8d98-d72e15a36295 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:35:01.298772 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-4a1dd4f3-0bcc-4a25-8d98-d72e15a36295 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: 99a31213-cbcb-4b2c-b07f-ab67e78a2096] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:35:01.321630 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-4a1dd4f3-0bcc-4a25-8d98-d72e15a36295 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:01.327745 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-4a1dd4f3-0bcc-4a25-8d98-d72e15a36295 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:01.331947 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-4a1dd4f3-0bcc-4a25-8d98-d72e15a36295 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:01.335331 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-4a1dd4f3-0bcc-4a25-8d98-d72e15a36295 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:01.376290 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-8da6b0da-3495-4678-bab4-abd18a182624 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc65fea19f94fd18d83ad8ce3bbb476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a42d5073b0f4e4c857d794aa8d30393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:35:01.394941 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-8da6b0da-3495-4678-bab4-abd18a182624 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] 10.222.0.57 "GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df" status: 200 len: 1359 microversion: 2.1 time: 0.748139 Jun 30 12:35:01.398227 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 139/283] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:35:00 2022] GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df => generated 1359 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:35:01.684070 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-4a1dd4f3-0bcc-4a25-8d98-d72e15a36295 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:35:01.694158 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-4a1dd4f3-0bcc-4a25-8d98-d72e15a36295 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/99a31213-cbcb-4b2c-b07f-ab67e78a2096" status: 200 len: 1522 microversion: 2.1 time: 0.402064 Jun 30 12:35:01.707162 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 145/284] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:35:01 2022] GET /compute/v2.1/servers/99a31213-cbcb-4b2c-b07f-ab67e78a2096 => generated 1522 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:35:02.413075 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-cdc63f47-5b82-4803-89fd-418212c2bde0 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:35:02.414454 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-cdc63f47-5b82-4803-89fd-418212c2bde0 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] [instance: d328d6c1-d49a-48c5-a26e-1ab70019f6df] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:35:02.422705 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG dbcounter [-] [124298] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=4 {{(pid=124298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:35:02.425230 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-cdc63f47-5b82-4803-89fd-418212c2bde0 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:02.426396 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-cdc63f47-5b82-4803-89fd-418212c2bde0 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:02.427617 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-cdc63f47-5b82-4803-89fd-418212c2bde0 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:02.428507 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-cdc63f47-5b82-4803-89fd-418212c2bde0 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:02.662986 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-cdc63f47-5b82-4803-89fd-418212c2bde0 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc65fea19f94fd18d83ad8ce3bbb476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a42d5073b0f4e4c857d794aa8d30393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:35:02.676335 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-cdc63f47-5b82-4803-89fd-418212c2bde0 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] 10.222.0.57 "GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df" status: 200 len: 1359 microversion: 2.1 time: 0.265838 Jun 30 12:35:02.686438 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 140/285] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:35:02 2022] GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df => generated 1359 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:35:02.714179 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-3879fcb9-3899-4e74-a891-adf286175c14 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:35:02.714948 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-3879fcb9-3899-4e74-a891-adf286175c14 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: 99a31213-cbcb-4b2c-b07f-ab67e78a2096] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:35:02.752707 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-3879fcb9-3899-4e74-a891-adf286175c14 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:02.753779 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-3879fcb9-3899-4e74-a891-adf286175c14 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:02.754839 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-3879fcb9-3899-4e74-a891-adf286175c14 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:02.755463 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-3879fcb9-3899-4e74-a891-adf286175c14 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:03.040552 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-3879fcb9-3899-4e74-a891-adf286175c14 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:35:03.052620 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-3879fcb9-3899-4e74-a891-adf286175c14 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/99a31213-cbcb-4b2c-b07f-ab67e78a2096" status: 200 len: 1522 microversion: 2.1 time: 0.343333 Jun 30 12:35:03.065079 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 146/286] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:35:02 2022] GET /compute/v2.1/servers/99a31213-cbcb-4b2c-b07f-ab67e78a2096 => generated 1522 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:35:03.694133 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-e32aaa2a-280d-4a05-999e-12d8331d17f1 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:35:03.695442 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-e32aaa2a-280d-4a05-999e-12d8331d17f1 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] [instance: d328d6c1-d49a-48c5-a26e-1ab70019f6df] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:35:03.702236 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-e32aaa2a-280d-4a05-999e-12d8331d17f1 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:03.702748 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-e32aaa2a-280d-4a05-999e-12d8331d17f1 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:03.709887 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-e32aaa2a-280d-4a05-999e-12d8331d17f1 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:03.710346 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-e32aaa2a-280d-4a05-999e-12d8331d17f1 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:04.075537 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-9b9fab2b-b75b-4263-ad1e-0d2a43f5b4d1 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:35:04.076151 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-9b9fab2b-b75b-4263-ad1e-0d2a43f5b4d1 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: 99a31213-cbcb-4b2c-b07f-ab67e78a2096] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:35:04.094745 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-9b9fab2b-b75b-4263-ad1e-0d2a43f5b4d1 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:04.095361 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-9b9fab2b-b75b-4263-ad1e-0d2a43f5b4d1 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:04.096166 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-9b9fab2b-b75b-4263-ad1e-0d2a43f5b4d1 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:04.096597 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-9b9fab2b-b75b-4263-ad1e-0d2a43f5b4d1 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:04.648869 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-e32aaa2a-280d-4a05-999e-12d8331d17f1 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc65fea19f94fd18d83ad8ce3bbb476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a42d5073b0f4e4c857d794aa8d30393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:35:04.659448 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-e32aaa2a-280d-4a05-999e-12d8331d17f1 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] 10.222.0.57 "GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df" status: 200 len: 1359 microversion: 2.1 time: 0.969789 Jun 30 12:35:04.673003 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 141/287] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:35:03 2022] GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df => generated 1359 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:35:04.691913 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-9b9fab2b-b75b-4263-ad1e-0d2a43f5b4d1 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:35:04.708449 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-9b9fab2b-b75b-4263-ad1e-0d2a43f5b4d1 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/99a31213-cbcb-4b2c-b07f-ab67e78a2096" status: 200 len: 1522 microversion: 2.1 time: 0.640392 Jun 30 12:35:04.709510 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 147/288] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:35:04 2022] GET /compute/v2.1/servers/99a31213-cbcb-4b2c-b07f-ab67e78a2096 => generated 1522 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:35:05.679223 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-d123fb32-7ad6-4f84-941b-4d89f8bf29f5 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:35:05.680444 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-d123fb32-7ad6-4f84-941b-4d89f8bf29f5 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] [instance: d328d6c1-d49a-48c5-a26e-1ab70019f6df] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:35:05.711754 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-d123fb32-7ad6-4f84-941b-4d89f8bf29f5 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:05.712709 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-d123fb32-7ad6-4f84-941b-4d89f8bf29f5 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:05.713754 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-d123fb32-7ad6-4f84-941b-4d89f8bf29f5 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:05.716394 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-d123fb32-7ad6-4f84-941b-4d89f8bf29f5 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:05.728607 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-596c8f63-180c-43f8-9071-121e6c782fce tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:35:05.729951 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-596c8f63-180c-43f8-9071-121e6c782fce tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: 99a31213-cbcb-4b2c-b07f-ab67e78a2096] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:35:05.744259 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-596c8f63-180c-43f8-9071-121e6c782fce tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:05.750430 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-596c8f63-180c-43f8-9071-121e6c782fce tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:05.752237 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-596c8f63-180c-43f8-9071-121e6c782fce tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:05.755863 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-596c8f63-180c-43f8-9071-121e6c782fce tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:06.433089 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-d123fb32-7ad6-4f84-941b-4d89f8bf29f5 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc65fea19f94fd18d83ad8ce3bbb476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a42d5073b0f4e4c857d794aa8d30393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:35:06.451493 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-d123fb32-7ad6-4f84-941b-4d89f8bf29f5 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] 10.222.0.57 "GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df" status: 200 len: 1359 microversion: 2.1 time: 0.771135 Jun 30 12:35:06.452461 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 142/289] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:35:05 2022] GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df => generated 1359 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:35:06.746912 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-596c8f63-180c-43f8-9071-121e6c782fce tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:35:06.790090 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-596c8f63-180c-43f8-9071-121e6c782fce tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/99a31213-cbcb-4b2c-b07f-ab67e78a2096" status: 200 len: 1522 microversion: 2.1 time: 1.067053 Jun 30 12:35:06.793150 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 148/290] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:35:05 2022] GET /compute/v2.1/servers/99a31213-cbcb-4b2c-b07f-ab67e78a2096 => generated 1522 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:35:07.469505 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-94e0fe15-145f-4266-bcc8-cdbb8255adf9 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:35:07.470313 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-94e0fe15-145f-4266-bcc8-cdbb8255adf9 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] [instance: d328d6c1-d49a-48c5-a26e-1ab70019f6df] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:35:07.490121 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG dbcounter [-] [124298] Writing DB stats nova_cell0:SELECT=2 {{(pid=124298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:35:07.498894 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG dbcounter [-] [124298] Writing DB stats nova_cell0:SELECT=10 {{(pid=124298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:35:07.501010 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-94e0fe15-145f-4266-bcc8-cdbb8255adf9 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:07.501521 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-94e0fe15-145f-4266-bcc8-cdbb8255adf9 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:07.502536 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-94e0fe15-145f-4266-bcc8-cdbb8255adf9 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:07.503026 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-94e0fe15-145f-4266-bcc8-cdbb8255adf9 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:07.815084 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-fffa6e33-b193-41f4-95d2-ded677937aca tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:35:07.815084 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-fffa6e33-b193-41f4-95d2-ded677937aca tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: 99a31213-cbcb-4b2c-b07f-ab67e78a2096] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:35:07.832889 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG dbcounter [-] [124297] Writing DB stats nova_cell0:SELECT=2 {{(pid=124297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:35:07.832889 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-fffa6e33-b193-41f4-95d2-ded677937aca tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:07.832889 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-fffa6e33-b193-41f4-95d2-ded677937aca tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:07.834465 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-fffa6e33-b193-41f4-95d2-ded677937aca tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:07.836825 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-fffa6e33-b193-41f4-95d2-ded677937aca tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:07.855030 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-94e0fe15-145f-4266-bcc8-cdbb8255adf9 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc65fea19f94fd18d83ad8ce3bbb476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a42d5073b0f4e4c857d794aa8d30393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:35:07.867135 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-94e0fe15-145f-4266-bcc8-cdbb8255adf9 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] 10.222.0.57 "GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df" status: 200 len: 1359 microversion: 2.1 time: 0.402174 Jun 30 12:35:07.879317 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 143/291] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:35:07 2022] GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df => generated 1359 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:35:08.337682 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-fffa6e33-b193-41f4-95d2-ded677937aca tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:35:08.347614 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-fffa6e33-b193-41f4-95d2-ded677937aca tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/99a31213-cbcb-4b2c-b07f-ab67e78a2096" status: 200 len: 1522 microversion: 2.1 time: 0.542260 Jun 30 12:35:08.356239 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 149/292] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:35:07 2022] GET /compute/v2.1/servers/99a31213-cbcb-4b2c-b07f-ab67e78a2096 => generated 1522 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:35:08.887325 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-b5daa026-9af0-49f5-9d2c-2c1349c79448 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:35:08.888052 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-b5daa026-9af0-49f5-9d2c-2c1349c79448 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] [instance: d328d6c1-d49a-48c5-a26e-1ab70019f6df] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:35:08.899285 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-b5daa026-9af0-49f5-9d2c-2c1349c79448 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:08.904270 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-b5daa026-9af0-49f5-9d2c-2c1349c79448 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:08.905727 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-b5daa026-9af0-49f5-9d2c-2c1349c79448 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:08.906528 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-b5daa026-9af0-49f5-9d2c-2c1349c79448 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:09.375761 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-9bf84e97-778b-4dde-a412-6a4c20af7f22 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:35:09.377213 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-9bf84e97-778b-4dde-a412-6a4c20af7f22 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: 99a31213-cbcb-4b2c-b07f-ab67e78a2096] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:35:09.393902 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-9bf84e97-778b-4dde-a412-6a4c20af7f22 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:09.397358 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-9bf84e97-778b-4dde-a412-6a4c20af7f22 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:09.398662 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-9bf84e97-778b-4dde-a412-6a4c20af7f22 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:09.400923 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-9bf84e97-778b-4dde-a412-6a4c20af7f22 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:09.477869 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG dbcounter [-] [124297] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:35:09.886500 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-b5daa026-9af0-49f5-9d2c-2c1349c79448 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc65fea19f94fd18d83ad8ce3bbb476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a42d5073b0f4e4c857d794aa8d30393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:35:09.908972 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-b5daa026-9af0-49f5-9d2c-2c1349c79448 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] 10.222.0.57 "GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df" status: 200 len: 1359 microversion: 2.1 time: 1.025162 Jun 30 12:35:09.910847 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 144/293] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:35:08 2022] GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df => generated 1359 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:35:09.917566 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-69731ebd-8535-49d9-99c2-d3a7c984292a tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:35:09.934612 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-69731ebd-8535-49d9-99c2-d3a7c984292a tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:09.938210 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-69731ebd-8535-49d9-99c2-d3a7c984292a tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:09.957737 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-9bf84e97-778b-4dde-a412-6a4c20af7f22 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:35:09.971436 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-9bf84e97-778b-4dde-a412-6a4c20af7f22 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/99a31213-cbcb-4b2c-b07f-ab67e78a2096" status: 200 len: 1522 microversion: 2.1 time: 0.597555 Jun 30 12:35:09.973737 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 150/294] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:35:09 2022] GET /compute/v2.1/servers/99a31213-cbcb-4b2c-b07f-ab67e78a2096 => generated 1522 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:35:10.089977 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-69731ebd-8535-49d9-99c2-d3a7c984292a tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 99ba3b96-6700-41e0-b2cf-ff8933b2bf94] Going to try to stop instance {{(pid=124298) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 30 12:35:10.185275 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-69731ebd-8535-49d9-99c2-d3a7c984292a tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "POST /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94/action" status: 202 len: 0 microversion: 2.1 time: 0.272866 Jun 30 12:35:10.187534 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 145/295] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Jun 30 12:35:09 2022] POST /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94/action => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 12:35:10.200356 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-81104636-3a53-40df-978b-5274e7276f7e tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:35:10.203412 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-81104636-3a53-40df-978b-5274e7276f7e tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 99ba3b96-6700-41e0-b2cf-ff8933b2bf94] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:35:10.244319 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-81104636-3a53-40df-978b-5274e7276f7e tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:10.244796 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-81104636-3a53-40df-978b-5274e7276f7e tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:10.245577 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-81104636-3a53-40df-978b-5274e7276f7e tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:10.246044 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-81104636-3a53-40df-978b-5274e7276f7e tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:10.521238 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-81104636-3a53-40df-978b-5274e7276f7e tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddb38b4d6864a6c96b84c9a4092eea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60d10dba1d947cc97149a063a810129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:35:10.538421 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-81104636-3a53-40df-978b-5274e7276f7e tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94" status: 200 len: 1722 microversion: 2.1 time: 0.340637 Jun 30 12:35:10.539234 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 151/296] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:35:10 2022] GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94 => generated 1722 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:35:10.928025 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-231fef6d-cf33-49e1-82c0-d724df1c8103 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:35:10.929880 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-231fef6d-cf33-49e1-82c0-d724df1c8103 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] [instance: d328d6c1-d49a-48c5-a26e-1ab70019f6df] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:35:10.956095 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-231fef6d-cf33-49e1-82c0-d724df1c8103 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:10.964476 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-231fef6d-cf33-49e1-82c0-d724df1c8103 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:10.970687 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-231fef6d-cf33-49e1-82c0-d724df1c8103 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:10.971424 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-231fef6d-cf33-49e1-82c0-d724df1c8103 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:10.991667 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-45f065d7-ab61-41ba-bbea-114bbaa8ff86 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:35:10.992881 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-45f065d7-ab61-41ba-bbea-114bbaa8ff86 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: 99a31213-cbcb-4b2c-b07f-ab67e78a2096] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:35:11.029203 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-45f065d7-ab61-41ba-bbea-114bbaa8ff86 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:11.030095 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-45f065d7-ab61-41ba-bbea-114bbaa8ff86 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:11.034312 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-45f065d7-ab61-41ba-bbea-114bbaa8ff86 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:11.034761 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-45f065d7-ab61-41ba-bbea-114bbaa8ff86 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:11.518401 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-45f065d7-ab61-41ba-bbea-114bbaa8ff86 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:35:11.542353 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-45f065d7-ab61-41ba-bbea-114bbaa8ff86 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/99a31213-cbcb-4b2c-b07f-ab67e78a2096" status: 200 len: 1522 microversion: 2.1 time: 0.554691 Jun 30 12:35:11.549921 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-231fef6d-cf33-49e1-82c0-d724df1c8103 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc65fea19f94fd18d83ad8ce3bbb476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a42d5073b0f4e4c857d794aa8d30393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:35:11.563942 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 152/297] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:35:10 2022] GET /compute/v2.1/servers/99a31213-cbcb-4b2c-b07f-ab67e78a2096 => generated 1522 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 12:35:11.574166 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-43af5dee-f6db-48b3-8ab9-34572798b2e9 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:35:11.575035 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-231fef6d-cf33-49e1-82c0-d724df1c8103 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] 10.222.0.57 "GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df" status: 200 len: 1359 microversion: 2.1 time: 0.641983 Jun 30 12:35:11.575236 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-43af5dee-f6db-48b3-8ab9-34572798b2e9 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 99ba3b96-6700-41e0-b2cf-ff8933b2bf94] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:35:11.577771 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 146/298] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:35:10 2022] GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df => generated 1359 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:35:11.584918 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-43af5dee-f6db-48b3-8ab9-34572798b2e9 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:11.585553 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-43af5dee-f6db-48b3-8ab9-34572798b2e9 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:11.586686 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-43af5dee-f6db-48b3-8ab9-34572798b2e9 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:11.587157 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-43af5dee-f6db-48b3-8ab9-34572798b2e9 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:11.923749 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-43af5dee-f6db-48b3-8ab9-34572798b2e9 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddb38b4d6864a6c96b84c9a4092eea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60d10dba1d947cc97149a063a810129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:35:11.932171 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-43af5dee-f6db-48b3-8ab9-34572798b2e9 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94" status: 200 len: 1722 microversion: 2.1 time: 0.367066 Jun 30 12:35:11.942708 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 153/299] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:35:11 2022] GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94 => generated 1722 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:35:12.568846 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-154e2e04-29d8-496c-ade0-566fcb09ed4a tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:35:12.569617 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-154e2e04-29d8-496c-ade0-566fcb09ed4a tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: 99a31213-cbcb-4b2c-b07f-ab67e78a2096] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:35:12.591259 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-154e2e04-29d8-496c-ade0-566fcb09ed4a tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:12.592240 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-154e2e04-29d8-496c-ade0-566fcb09ed4a tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:12.595274 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-2a856b26-11a0-4b0f-87a9-c457cfd72bfb tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:35:12.596810 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-2a856b26-11a0-4b0f-87a9-c457cfd72bfb tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] [instance: d328d6c1-d49a-48c5-a26e-1ab70019f6df] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:35:12.597352 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-154e2e04-29d8-496c-ade0-566fcb09ed4a tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:12.597965 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-154e2e04-29d8-496c-ade0-566fcb09ed4a tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:12.615821 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-2a856b26-11a0-4b0f-87a9-c457cfd72bfb tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:12.616437 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-2a856b26-11a0-4b0f-87a9-c457cfd72bfb tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:12.617368 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-2a856b26-11a0-4b0f-87a9-c457cfd72bfb tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:12.622265 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-2a856b26-11a0-4b0f-87a9-c457cfd72bfb tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:13.073377 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-2a856b26-11a0-4b0f-87a9-c457cfd72bfb tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc65fea19f94fd18d83ad8ce3bbb476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a42d5073b0f4e4c857d794aa8d30393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:35:13.085204 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-2a856b26-11a0-4b0f-87a9-c457cfd72bfb tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] 10.222.0.57 "GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df" status: 200 len: 1359 microversion: 2.1 time: 0.495231 Jun 30 12:35:13.086100 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 154/300] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:35:12 2022] GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df => generated 1359 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 12:35:13.100402 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-bea71f1d-e9a8-4310-9f29-e8d5578d258d tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:35:13.116512 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-bea71f1d-e9a8-4310-9f29-e8d5578d258d tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 99ba3b96-6700-41e0-b2cf-ff8933b2bf94] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:35:13.126395 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG dbcounter [-] [124297] Writing DB stats nova_api:SELECT=45 {{(pid=124297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:35:13.126717 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-154e2e04-29d8-496c-ade0-566fcb09ed4a tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:35:13.128576 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-bea71f1d-e9a8-4310-9f29-e8d5578d258d tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:13.129222 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-bea71f1d-e9a8-4310-9f29-e8d5578d258d tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:13.130771 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-bea71f1d-e9a8-4310-9f29-e8d5578d258d tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:13.137071 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-bea71f1d-e9a8-4310-9f29-e8d5578d258d tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:13.161676 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-154e2e04-29d8-496c-ade0-566fcb09ed4a tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/99a31213-cbcb-4b2c-b07f-ab67e78a2096" status: 200 len: 1522 microversion: 2.1 time: 0.595825 Jun 30 12:35:13.163166 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 147/301] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:35:12 2022] GET /compute/v2.1/servers/99a31213-cbcb-4b2c-b07f-ab67e78a2096 => generated 1522 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:35:13.528386 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-bea71f1d-e9a8-4310-9f29-e8d5578d258d tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddb38b4d6864a6c96b84c9a4092eea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60d10dba1d947cc97149a063a810129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:35:13.542103 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-bea71f1d-e9a8-4310-9f29-e8d5578d258d tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94" status: 200 len: 1722 microversion: 2.1 time: 0.454933 Jun 30 12:35:13.542927 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 155/302] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:35:13 2022] GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94 => generated 1722 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:35:14.111729 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-59cef8e4-67bb-4120-9ee5-37cdcfd28635 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:35:14.111729 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-59cef8e4-67bb-4120-9ee5-37cdcfd28635 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] [instance: d328d6c1-d49a-48c5-a26e-1ab70019f6df] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:35:14.123302 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-59cef8e4-67bb-4120-9ee5-37cdcfd28635 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:14.124011 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-59cef8e4-67bb-4120-9ee5-37cdcfd28635 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:14.124945 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-59cef8e4-67bb-4120-9ee5-37cdcfd28635 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:14.125399 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-59cef8e4-67bb-4120-9ee5-37cdcfd28635 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:14.179565 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-c5b6e94f-95ee-44ab-a6b4-5e3f8bdac272 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:35:14.180336 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-c5b6e94f-95ee-44ab-a6b4-5e3f8bdac272 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: 99a31213-cbcb-4b2c-b07f-ab67e78a2096] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:35:14.197808 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-c5b6e94f-95ee-44ab-a6b4-5e3f8bdac272 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:14.199154 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-c5b6e94f-95ee-44ab-a6b4-5e3f8bdac272 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:14.203300 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-c5b6e94f-95ee-44ab-a6b4-5e3f8bdac272 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:14.204036 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-c5b6e94f-95ee-44ab-a6b4-5e3f8bdac272 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:15.127129 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-c5b6e94f-95ee-44ab-a6b4-5e3f8bdac272 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:35:15.141734 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-c5b6e94f-95ee-44ab-a6b4-5e3f8bdac272 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/99a31213-cbcb-4b2c-b07f-ab67e78a2096" status: 200 len: 1522 microversion: 2.1 time: 0.965980 Jun 30 12:35:15.145468 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 156/303] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:35:14 2022] GET /compute/v2.1/servers/99a31213-cbcb-4b2c-b07f-ab67e78a2096 => generated 1522 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:35:15.152025 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-59cef8e4-67bb-4120-9ee5-37cdcfd28635 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc65fea19f94fd18d83ad8ce3bbb476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a42d5073b0f4e4c857d794aa8d30393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:35:15.161979 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-bffc7353-715e-4376-b1f6-8745a185ebc4 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:35:15.178768 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-bffc7353-715e-4376-b1f6-8745a185ebc4 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 99ba3b96-6700-41e0-b2cf-ff8933b2bf94] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:35:15.179450 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-59cef8e4-67bb-4120-9ee5-37cdcfd28635 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] 10.222.0.57 "GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df" status: 200 len: 1359 microversion: 2.1 time: 1.079137 Jun 30 12:35:15.180702 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 148/304] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:35:14 2022] GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df => generated 1359 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 12:35:15.206188 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-bffc7353-715e-4376-b1f6-8745a185ebc4 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:15.206188 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-bffc7353-715e-4376-b1f6-8745a185ebc4 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:15.214033 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-bffc7353-715e-4376-b1f6-8745a185ebc4 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:15.219624 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-bffc7353-715e-4376-b1f6-8745a185ebc4 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:15.460936 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-bffc7353-715e-4376-b1f6-8745a185ebc4 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddb38b4d6864a6c96b84c9a4092eea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60d10dba1d947cc97149a063a810129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:35:15.470279 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-bffc7353-715e-4376-b1f6-8745a185ebc4 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94" status: 200 len: 1722 microversion: 2.1 time: 0.319307 Jun 30 12:35:15.471120 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 157/305] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:35:15 2022] GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94 => generated 1722 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:35:16.163639 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-f6727381-362f-4208-aa64-61bb018e12ac tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:35:16.166896 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-f6727381-362f-4208-aa64-61bb018e12ac tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: 99a31213-cbcb-4b2c-b07f-ab67e78a2096] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:35:16.181457 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-f6727381-362f-4208-aa64-61bb018e12ac tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:16.182293 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-f6727381-362f-4208-aa64-61bb018e12ac tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:16.183175 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-f6727381-362f-4208-aa64-61bb018e12ac tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:16.183703 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-f6727381-362f-4208-aa64-61bb018e12ac tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:16.199146 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-652ca1c7-4796-44fc-a3c6-c45b6deb6473 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:35:16.199869 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-652ca1c7-4796-44fc-a3c6-c45b6deb6473 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] [instance: d328d6c1-d49a-48c5-a26e-1ab70019f6df] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:35:16.216716 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-652ca1c7-4796-44fc-a3c6-c45b6deb6473 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:16.217501 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-652ca1c7-4796-44fc-a3c6-c45b6deb6473 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:16.218182 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-652ca1c7-4796-44fc-a3c6-c45b6deb6473 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:16.218846 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-652ca1c7-4796-44fc-a3c6-c45b6deb6473 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:16.233337 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG dbcounter [-] [124298] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:35:16.732506 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-652ca1c7-4796-44fc-a3c6-c45b6deb6473 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc65fea19f94fd18d83ad8ce3bbb476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a42d5073b0f4e4c857d794aa8d30393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:35:16.746198 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-f6727381-362f-4208-aa64-61bb018e12ac tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:35:16.751067 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-652ca1c7-4796-44fc-a3c6-c45b6deb6473 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] 10.222.0.57 "GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df" status: 200 len: 1359 microversion: 2.1 time: 0.558034 Jun 30 12:35:16.751659 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 158/306] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:35:16 2022] GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df => generated 1359 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:35:16.756247 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-f6727381-362f-4208-aa64-61bb018e12ac tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/99a31213-cbcb-4b2c-b07f-ab67e78a2096" status: 200 len: 1502 microversion: 2.1 time: 0.597859 Jun 30 12:35:16.759264 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 149/307] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:35:16 2022] GET /compute/v2.1/servers/99a31213-cbcb-4b2c-b07f-ab67e78a2096 => generated 1502 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:35:16.760464 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-988f7222-b20a-4ed6-bf08-5870ec2a3032 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:35:16.761106 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-988f7222-b20a-4ed6-bf08-5870ec2a3032 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 99ba3b96-6700-41e0-b2cf-ff8933b2bf94] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:35:16.773446 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-988f7222-b20a-4ed6-bf08-5870ec2a3032 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:16.774189 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-988f7222-b20a-4ed6-bf08-5870ec2a3032 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:16.775217 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-988f7222-b20a-4ed6-bf08-5870ec2a3032 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:16.775656 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-988f7222-b20a-4ed6-bf08-5870ec2a3032 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:16.781832 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-15c426c9-da8e-4386-9b27-6f96457f2621 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "599e3fa0-e977-411f-b78a-8ebde0ff05e0"}} {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:35:16.783450 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-15c426c9-da8e-4386-9b27-6f96457f2621 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: 99a31213-cbcb-4b2c-b07f-ab67e78a2096] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:35:16.803029 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-15c426c9-da8e-4386-9b27-6f96457f2621 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:16.803606 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-15c426c9-da8e-4386-9b27-6f96457f2621 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:16.804674 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-15c426c9-da8e-4386-9b27-6f96457f2621 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:16.805307 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-15c426c9-da8e-4386-9b27-6f96457f2621 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:16.864312 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.wsgi [None req-15c426c9-da8e-4386-9b27-6f96457f2621 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] HTTP exception thrown: Cannot 'attach_volume' instance 99a31213-cbcb-4b2c-b07f-ab67e78a2096 while it is in vm_state rescued Jun 30 12:35:16.873575 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-15c426c9-da8e-4386-9b27-6f96457f2621 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Request method failure captured: Jun 30 12:35:16.873575 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: request: POST /compute/v2.1/servers/99a31213-cbcb-4b2c-b07f-ab67e78a2096/os-volume_attachments HTTP/1.1 Jun 30 12:35:16.873575 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Accept: application/json Jun 30 12:35:16.873575 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Accept-Encoding: identity Jun 30 12:35:16.873575 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Connection: close Jun 30 12:35:16.873575 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Content-Length: 74 Jun 30 12:35:16.873575 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Content-Type: application/json Jun 30 12:35:16.873575 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Host: 10.222.0.57 Jun 30 12:35:16.873575 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Openstack-System-Scope: None Jun 30 12:35:16.873575 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: User-Agent: python-urllib3/1.26.9 Jun 30 12:35:16.873575 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Auth-Token: gAAAAABivZf_BQGmfS0HOoL_I4T5VOYxBuxZGY2QWD4EHtWbjr8O76qqmYfKKC4FlZ72eOwJFTdgHeD24bmk91RgL5Xpb2Vmu8gdl5stiFwB3gOIKDDDppLMeT3KoEQDYGRtO6bS_AC7MydPE6Kd2zAsainH0ZDMCZDu5MtfqV2V5srDhTVvC8U Jun 30 12:35:16.873575 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Domain-Id: None Jun 30 12:35:16.873575 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Domain-Name: None Jun 30 12:35:16.873575 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Identity-Status: Confirmed Jun 30 12:35:16.873575 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Is-Admin-Project: True Jun 30 12:35:16.873575 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Domain-Id: default Jun 30 12:35:16.873575 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Domain-Name: Default Jun 30 12:35:16.873575 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Id: 663ec7a59bc147299f904d93d119c5e7 Jun 30 12:35:16.873575 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1641653126 Jun 30 12:35:16.873575 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Role: member,reader Jun 30 12:35:16.873575 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Roles: member,reader Jun 30 12:35:16.875303 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/663ec7a59bc147299f904d93d119c5e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/663ec7a59bc147299f904d93d119c5e7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_663ec7a59bc147299f904d93d119c5e7", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/663ec7a59bc147299f904d93d119c5e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 30 12:35:16.875303 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1641653126 Jun 30 12:35:16.875303 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant-Id: 663ec7a59bc147299f904d93d119c5e7 Jun 30 12:35:16.875303 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1641653126 Jun 30 12:35:16.875303 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User: tempest-ServerRescueNegativeTestJSON-1641653126-project Jun 30 12:35:16.875303 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Domain-Id: default Jun 30 12:35:16.875303 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Domain-Name: Default Jun 30 12:35:16.875303 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Id: 26807e5e7aab425eb28e781289794265 Jun 30 12:35:16.875303 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1641653126-project Jun 30 12:35:16.875303 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Jun 30 12:35:16.875303 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: {"volumeAttachment": {"volumeId": "599e3fa0-e977-411f-b78a-8ebde0ff05e0"}} Jun 30 12:35:16.875303 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: method: > Jun 30 12:35:16.876081 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: exception: Cannot 'attach_volume' instance 99a31213-cbcb-4b2c-b07f-ab67e78a2096 while it is in vm_state rescued Jun 30 12:35:16.876081 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: action_args: {'server_id': '99a31213-cbcb-4b2c-b07f-ab67e78a2096', 'body': {'volumeAttachment': {'volumeId': '599e3fa0-e977-411f-b78a-8ebde0ff05e0'}}} Jun 30 12:35:16.876081 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 12:35:16.876081 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:35:16.876081 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 30 12:35:16.876081 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 30 12:35:16.876081 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 30 12:35:16.876081 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 30 12:35:16.876081 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 30 12:35:16.876081 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 30 12:35:16.876081 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 99a31213-cbcb-4b2c-b07f-ab67e78a2096 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 30 12:35:16.876081 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:35:16.876081 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:35:16.876081 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:35:16.876081 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:35:16.876081 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:35:16.876081 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:35:16.876081 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 12:35:16.876081 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 12:35:16.877281 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 12:35:16.877281 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 12:35:16.877281 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 30 12:35:16.877281 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 30 12:35:16.877281 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 30 12:35:16.877281 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 30 12:35:16.877281 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 30 12:35:16.877281 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 30 12:35:16.877281 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 30 12:35:16.877281 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 30 12:35:16.877281 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 30 12:35:16.877281 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 30 12:35:16.877281 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 99a31213-cbcb-4b2c-b07f-ab67e78a2096 while it is in vm_state rescued Jun 30 12:35:16.877281 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:35:16.877281 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:35:16.877281 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:35:16.877281 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:35:16.877281 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:35:16.877281 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:35:16.878396 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 12:35:16.878396 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 12:35:16.878396 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 99a31213-cbcb-4b2c-b07f-ab67e78a2096 while it is in vm_state rescued Jun 30 12:35:16.878396 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:35:16.878396 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-15c426c9-da8e-4386-9b27-6f96457f2621 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Returning 409 to user: Cannot 'attach_volume' instance 99a31213-cbcb-4b2c-b07f-ab67e78a2096 while it is in vm_state rescued {{(pid=124298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 12:35:16.878396 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-15c426c9-da8e-4386-9b27-6f96457f2621 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "POST /compute/v2.1/servers/99a31213-cbcb-4b2c-b07f-ab67e78a2096/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.098681 Jun 30 12:35:16.878923 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 150/308] 10.222.0.57 () {60 vars in 1322 bytes} [Thu Jun 30 12:35:16 2022] POST /compute/v2.1/servers/99a31213-cbcb-4b2c-b07f-ab67e78a2096/os-volume_attachments => generated 152 bytes in 103 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jun 30 12:35:16.884792 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-2aab4cbd-c1ed-48b2-ad93-b7de7ac4dc0f tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:35:16.885391 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-2aab4cbd-c1ed-48b2-ad93-b7de7ac4dc0f tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: 99a31213-cbcb-4b2c-b07f-ab67e78a2096] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:35:16.910754 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-2aab4cbd-c1ed-48b2-ad93-b7de7ac4dc0f tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:16.911554 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-2aab4cbd-c1ed-48b2-ad93-b7de7ac4dc0f tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:16.912544 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-2aab4cbd-c1ed-48b2-ad93-b7de7ac4dc0f tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:16.913756 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-2aab4cbd-c1ed-48b2-ad93-b7de7ac4dc0f tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:17.046133 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-2aab4cbd-c1ed-48b2-ad93-b7de7ac4dc0f tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "POST /compute/v2.1/servers/99a31213-cbcb-4b2c-b07f-ab67e78a2096/action" status: 202 len: 0 microversion: 2.1 time: 0.165050 Jun 30 12:35:17.048689 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 151/309] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Jun 30 12:35:16 2022] POST /compute/v2.1/servers/99a31213-cbcb-4b2c-b07f-ab67e78a2096/action => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 12:35:17.074381 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-d13dcb80-f509-45e6-9aa7-b4f782945acc tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:35:17.078063 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-d13dcb80-f509-45e6-9aa7-b4f782945acc tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: 99a31213-cbcb-4b2c-b07f-ab67e78a2096] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:35:17.093739 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-d13dcb80-f509-45e6-9aa7-b4f782945acc tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:17.094055 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-d13dcb80-f509-45e6-9aa7-b4f782945acc tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:17.094897 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-d13dcb80-f509-45e6-9aa7-b4f782945acc tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:17.095991 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-d13dcb80-f509-45e6-9aa7-b4f782945acc tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:17.178813 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-988f7222-b20a-4ed6-bf08-5870ec2a3032 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddb38b4d6864a6c96b84c9a4092eea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60d10dba1d947cc97149a063a810129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:35:17.197356 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-988f7222-b20a-4ed6-bf08-5870ec2a3032 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94" status: 200 len: 1722 microversion: 2.1 time: 0.440875 Jun 30 12:35:17.197975 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 159/310] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:35:16 2022] GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94 => generated 1722 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:35:17.413537 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-d13dcb80-f509-45e6-9aa7-b4f782945acc tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:35:17.422275 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-d13dcb80-f509-45e6-9aa7-b4f782945acc tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/99a31213-cbcb-4b2c-b07f-ab67e78a2096" status: 200 len: 1510 microversion: 2.1 time: 0.361647 Jun 30 12:35:17.427457 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 152/311] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:35:17 2022] GET /compute/v2.1/servers/99a31213-cbcb-4b2c-b07f-ab67e78a2096 => generated 1510 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 12:35:17.779230 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-c17c6dd6-aa8a-40c3-a3f2-1faf9def1b59 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:35:17.779986 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-c17c6dd6-aa8a-40c3-a3f2-1faf9def1b59 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] [instance: d328d6c1-d49a-48c5-a26e-1ab70019f6df] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:35:17.794902 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-c17c6dd6-aa8a-40c3-a3f2-1faf9def1b59 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:17.796392 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-c17c6dd6-aa8a-40c3-a3f2-1faf9def1b59 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:17.797785 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-c17c6dd6-aa8a-40c3-a3f2-1faf9def1b59 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:17.799747 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-c17c6dd6-aa8a-40c3-a3f2-1faf9def1b59 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:18.215504 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-221e00df-9db9-4afa-8d4d-e98d37b9a61e tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:35:18.215886 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-c17c6dd6-aa8a-40c3-a3f2-1faf9def1b59 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc65fea19f94fd18d83ad8ce3bbb476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a42d5073b0f4e4c857d794aa8d30393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:35:18.216590 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-221e00df-9db9-4afa-8d4d-e98d37b9a61e tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 99ba3b96-6700-41e0-b2cf-ff8933b2bf94] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:35:18.229237 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-c17c6dd6-aa8a-40c3-a3f2-1faf9def1b59 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] 10.222.0.57 "GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df" status: 200 len: 1359 microversion: 2.1 time: 0.452489 Jun 30 12:35:18.230575 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 160/312] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:35:17 2022] GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df => generated 1359 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:35:18.242794 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-221e00df-9db9-4afa-8d4d-e98d37b9a61e tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:18.243236 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-221e00df-9db9-4afa-8d4d-e98d37b9a61e tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:18.247653 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-221e00df-9db9-4afa-8d4d-e98d37b9a61e tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:18.248112 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-221e00df-9db9-4afa-8d4d-e98d37b9a61e tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:18.445133 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-25f85e6d-ed9d-4ca4-bc41-8bd8335eebbf tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:35:18.446114 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-25f85e6d-ed9d-4ca4-bc41-8bd8335eebbf tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: 99a31213-cbcb-4b2c-b07f-ab67e78a2096] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:35:18.460273 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-25f85e6d-ed9d-4ca4-bc41-8bd8335eebbf tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:18.460874 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-25f85e6d-ed9d-4ca4-bc41-8bd8335eebbf tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:18.461937 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-25f85e6d-ed9d-4ca4-bc41-8bd8335eebbf tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:18.462831 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-25f85e6d-ed9d-4ca4-bc41-8bd8335eebbf tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:18.655163 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-25f85e6d-ed9d-4ca4-bc41-8bd8335eebbf tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:35:18.666886 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-25f85e6d-ed9d-4ca4-bc41-8bd8335eebbf tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/99a31213-cbcb-4b2c-b07f-ab67e78a2096" status: 200 len: 1510 microversion: 2.1 time: 0.225803 Jun 30 12:35:18.669018 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 161/313] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:35:18 2022] GET /compute/v2.1/servers/99a31213-cbcb-4b2c-b07f-ab67e78a2096 => generated 1510 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 12:35:18.696026 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-221e00df-9db9-4afa-8d4d-e98d37b9a61e tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddb38b4d6864a6c96b84c9a4092eea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60d10dba1d947cc97149a063a810129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:35:18.705641 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-221e00df-9db9-4afa-8d4d-e98d37b9a61e tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94" status: 200 len: 1722 microversion: 2.1 time: 0.494468 Jun 30 12:35:18.707019 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 153/314] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:35:18 2022] GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94 => generated 1722 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 12:35:19.248799 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-32aa4f7f-6da8-4dae-abb9-7701df5aaddd tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:35:19.250819 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-32aa4f7f-6da8-4dae-abb9-7701df5aaddd tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] [instance: d328d6c1-d49a-48c5-a26e-1ab70019f6df] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:35:19.267014 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-32aa4f7f-6da8-4dae-abb9-7701df5aaddd tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:19.267975 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-32aa4f7f-6da8-4dae-abb9-7701df5aaddd tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:19.270826 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-32aa4f7f-6da8-4dae-abb9-7701df5aaddd tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:19.272677 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-32aa4f7f-6da8-4dae-abb9-7701df5aaddd tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:19.687666 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-65530c71-553b-4df1-84ff-335a1eeb6a6a tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:35:19.688420 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-65530c71-553b-4df1-84ff-335a1eeb6a6a tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: 99a31213-cbcb-4b2c-b07f-ab67e78a2096] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:35:19.705136 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-65530c71-553b-4df1-84ff-335a1eeb6a6a tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:19.709779 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-32aa4f7f-6da8-4dae-abb9-7701df5aaddd tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc65fea19f94fd18d83ad8ce3bbb476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a42d5073b0f4e4c857d794aa8d30393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:35:19.720329 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-65530c71-553b-4df1-84ff-335a1eeb6a6a tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:19.721390 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-65530c71-553b-4df1-84ff-335a1eeb6a6a tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:19.721835 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-65530c71-553b-4df1-84ff-335a1eeb6a6a tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:19.723737 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-32aa4f7f-6da8-4dae-abb9-7701df5aaddd tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] 10.222.0.57 "GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df" status: 200 len: 1359 microversion: 2.1 time: 0.479614 Jun 30 12:35:19.724333 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 162/315] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:35:19 2022] GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df => generated 1359 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:35:19.746694 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-e305d65a-1a59-406f-9fec-9b6643f41690 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:35:19.750214 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-e305d65a-1a59-406f-9fec-9b6643f41690 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 99ba3b96-6700-41e0-b2cf-ff8933b2bf94] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:35:19.771902 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-e305d65a-1a59-406f-9fec-9b6643f41690 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:19.781188 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-e305d65a-1a59-406f-9fec-9b6643f41690 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:19.782168 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-e305d65a-1a59-406f-9fec-9b6643f41690 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:19.786535 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-e305d65a-1a59-406f-9fec-9b6643f41690 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:20.591994 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-65530c71-553b-4df1-84ff-335a1eeb6a6a tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:35:20.603345 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-65530c71-553b-4df1-84ff-335a1eeb6a6a tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/99a31213-cbcb-4b2c-b07f-ab67e78a2096" status: 200 len: 1510 microversion: 2.1 time: 0.918841 Jun 30 12:35:20.606686 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 154/316] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:35:19 2022] GET /compute/v2.1/servers/99a31213-cbcb-4b2c-b07f-ab67e78a2096 => generated 1510 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:35:20.612869 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [req-bcbb4d85-a678-4447-b483-6d5a43d07154 req-8bed0177-2842-466a-9b22-61ce14f83c47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d328d6c1-d49a-48c5-a26e-1ab70019f6df", "name": "network-vif-plugged", "status": "completed", "tag": "a04c1ee8-5a15-46b6-87ec-288a776bc842"}]} {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:35:20.637875 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [req-bcbb4d85-a678-4447-b483-6d5a43d07154 req-8bed0177-2842-466a-9b22-61ce14f83c47 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:20.641045 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [req-bcbb4d85-a678-4447-b483-6d5a43d07154 req-8bed0177-2842-466a-9b22-61ce14f83c47 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:20.672935 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.compute.server_external_events [req-bcbb4d85-a678-4447-b483-6d5a43d07154 req-8bed0177-2842-466a-9b22-61ce14f83c47 service nova] Creating event network-vif-plugged:a04c1ee8-5a15-46b6-87ec-288a776bc842 for instance d328d6c1-d49a-48c5-a26e-1ab70019f6df on hv-cinder-84614 Jun 30 12:35:20.678379 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [req-bcbb4d85-a678-4447-b483-6d5a43d07154 req-8bed0177-2842-466a-9b22-61ce14f83c47 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070141 Jun 30 12:35:20.679598 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 155/317] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 30 12:35:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:35:20.748846 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-3e49e57a-1737-4282-825c-996dc0f76c77 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:35:20.759515 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-3e49e57a-1737-4282-825c-996dc0f76c77 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] [instance: d328d6c1-d49a-48c5-a26e-1ab70019f6df] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:35:20.778779 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-e305d65a-1a59-406f-9fec-9b6643f41690 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddb38b4d6864a6c96b84c9a4092eea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60d10dba1d947cc97149a063a810129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:35:20.791452 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-e305d65a-1a59-406f-9fec-9b6643f41690 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94" status: 200 len: 1722 microversion: 2.1 time: 1.066034 Jun 30 12:35:20.793691 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-3e49e57a-1737-4282-825c-996dc0f76c77 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:20.794148 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-3e49e57a-1737-4282-825c-996dc0f76c77 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:20.794952 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-3e49e57a-1737-4282-825c-996dc0f76c77 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:20.795432 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-3e49e57a-1737-4282-825c-996dc0f76c77 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:20.801011 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 163/318] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:35:19 2022] GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94 => generated 1722 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:35:21.267508 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-3e49e57a-1737-4282-825c-996dc0f76c77 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc65fea19f94fd18d83ad8ce3bbb476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a42d5073b0f4e4c857d794aa8d30393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:35:21.278413 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-3e49e57a-1737-4282-825c-996dc0f76c77 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] 10.222.0.57 "GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df" status: 200 len: 1359 microversion: 2.1 time: 0.532357 Jun 30 12:35:21.279677 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 156/319] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:35:20 2022] GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df => generated 1359 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:35:21.624558 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-9372b0dc-ebec-4d75-a7e8-1d4acc74675a tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:35:21.625473 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-9372b0dc-ebec-4d75-a7e8-1d4acc74675a tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: 99a31213-cbcb-4b2c-b07f-ab67e78a2096] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:35:21.634184 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-9372b0dc-ebec-4d75-a7e8-1d4acc74675a tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:21.635721 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-9372b0dc-ebec-4d75-a7e8-1d4acc74675a tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:21.636811 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-9372b0dc-ebec-4d75-a7e8-1d4acc74675a tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:21.637464 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-9372b0dc-ebec-4d75-a7e8-1d4acc74675a tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:21.817662 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-a4d75045-f0f4-4c00-a657-952200cda62c tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:35:21.818246 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-a4d75045-f0f4-4c00-a657-952200cda62c tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 99ba3b96-6700-41e0-b2cf-ff8933b2bf94] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:35:21.825997 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-a4d75045-f0f4-4c00-a657-952200cda62c tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:21.826447 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-a4d75045-f0f4-4c00-a657-952200cda62c tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:21.828275 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-a4d75045-f0f4-4c00-a657-952200cda62c tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:21.829214 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-a4d75045-f0f4-4c00-a657-952200cda62c tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:22.321257 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-9372b0dc-ebec-4d75-a7e8-1d4acc74675a tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:35:22.343451 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-a4d75045-f0f4-4c00-a657-952200cda62c tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddb38b4d6864a6c96b84c9a4092eea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60d10dba1d947cc97149a063a810129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:35:22.344887 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-9372b0dc-ebec-4d75-a7e8-1d4acc74675a tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/99a31213-cbcb-4b2c-b07f-ab67e78a2096" status: 200 len: 1516 microversion: 2.1 time: 0.724545 Jun 30 12:35:22.345773 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 164/320] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:35:21 2022] GET /compute/v2.1/servers/99a31213-cbcb-4b2c-b07f-ab67e78a2096 => generated 1516 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:35:22.377971 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-54c8c5ba-be3c-4e00-af66-9006085557a3 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:35:22.383017 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-54c8c5ba-be3c-4e00-af66-9006085557a3 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] [instance: d328d6c1-d49a-48c5-a26e-1ab70019f6df] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:35:22.387988 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-a4d75045-f0f4-4c00-a657-952200cda62c tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94" status: 200 len: 1722 microversion: 2.1 time: 0.569157 Jun 30 12:35:22.395051 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 157/321] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:35:21 2022] GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94 => generated 1722 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 12:35:22.397420 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-54c8c5ba-be3c-4e00-af66-9006085557a3 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:22.398072 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-54c8c5ba-be3c-4e00-af66-9006085557a3 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:22.399303 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-54c8c5ba-be3c-4e00-af66-9006085557a3 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:22.401516 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-54c8c5ba-be3c-4e00-af66-9006085557a3 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:23.245891 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-54c8c5ba-be3c-4e00-af66-9006085557a3 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc65fea19f94fd18d83ad8ce3bbb476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a42d5073b0f4e4c857d794aa8d30393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:35:23.262073 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-54c8c5ba-be3c-4e00-af66-9006085557a3 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] 10.222.0.57 "GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df" status: 200 len: 1359 microversion: 2.1 time: 0.914850 Jun 30 12:35:23.262735 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 165/322] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:35:22 2022] GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df => generated 1359 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:35:23.411379 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-59a6b16d-4d8e-41c3-a7c6-293ecc9a53c1 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:35:23.412000 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-59a6b16d-4d8e-41c3-a7c6-293ecc9a53c1 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 99ba3b96-6700-41e0-b2cf-ff8933b2bf94] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:35:23.423808 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-59a6b16d-4d8e-41c3-a7c6-293ecc9a53c1 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:23.424258 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-59a6b16d-4d8e-41c3-a7c6-293ecc9a53c1 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:23.425080 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-59a6b16d-4d8e-41c3-a7c6-293ecc9a53c1 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:23.425513 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-59a6b16d-4d8e-41c3-a7c6-293ecc9a53c1 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:23.725477 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-59a6b16d-4d8e-41c3-a7c6-293ecc9a53c1 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddb38b4d6864a6c96b84c9a4092eea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60d10dba1d947cc97149a063a810129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:35:23.736315 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-59a6b16d-4d8e-41c3-a7c6-293ecc9a53c1 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94" status: 200 len: 1722 microversion: 2.1 time: 0.330451 Jun 30 12:35:23.754080 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 158/323] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:35:23 2022] GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94 => generated 1722 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:35:24.218200 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-ef908bf7-609e-4d9f-a30a-18559dc136b9 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Action: 'create', calling method: .version_select at 0x7fd0e0460e50>, body: {"keypair": {"name": "tempest-keypair-903132750", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMJKrq0TCURkShPH8uuKpAdM5oyNn/B2g3qid6al0iexzDfOJzDG+PNmzbt+xZfLQcsR/W7C2ONTT/8Eha8K9k++CK3Xa1eLE/e7EEqpyHTFhqIWWPMPuHnqiSrknvZfsQ=="}} {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:35:24.258221 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.quota [None req-ef908bf7-609e-4d9f-a30a-18559dc136b9 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Getting quotas for project 663ec7a59bc147299f904d93d119c5e7. Resources: {'key_pairs'} {{(pid=124297) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 12:35:24.272109 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.quota [None req-ef908bf7-609e-4d9f-a30a-18559dc136b9 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Getting quotas for user 26807e5e7aab425eb28e781289794265 and project 663ec7a59bc147299f904d93d119c5e7. Resources: {'key_pairs'} {{(pid=124297) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 12:35:24.280153 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-20a371cc-4919-40e8-9572-0ddb042ce397 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:35:24.281082 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-20a371cc-4919-40e8-9572-0ddb042ce397 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] [instance: d328d6c1-d49a-48c5-a26e-1ab70019f6df] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:35:24.300786 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-20a371cc-4919-40e8-9572-0ddb042ce397 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:24.302654 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-20a371cc-4919-40e8-9572-0ddb042ce397 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:24.306889 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-20a371cc-4919-40e8-9572-0ddb042ce397 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:24.307198 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-20a371cc-4919-40e8-9572-0ddb042ce397 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:24.372477 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-ef908bf7-609e-4d9f-a30a-18559dc136b9 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.160717 Jun 30 12:35:24.373888 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 166/324] 10.222.0.57 () {60 vars in 1158 bytes} [Thu Jun 30 12:35:24 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:35:24.762483 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-ad3cfda3-3f68-418e-898b-c28c9b8e27aa tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:35:24.763107 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-ad3cfda3-3f68-418e-898b-c28c9b8e27aa tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 99ba3b96-6700-41e0-b2cf-ff8933b2bf94] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:35:24.775351 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-ad3cfda3-3f68-418e-898b-c28c9b8e27aa tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:24.776854 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-ad3cfda3-3f68-418e-898b-c28c9b8e27aa tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:24.778686 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-ad3cfda3-3f68-418e-898b-c28c9b8e27aa tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:24.780668 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-ad3cfda3-3f68-418e-898b-c28c9b8e27aa tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:24.845502 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-20a371cc-4919-40e8-9572-0ddb042ce397 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc65fea19f94fd18d83ad8ce3bbb476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a42d5073b0f4e4c857d794aa8d30393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:35:24.861009 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-20a371cc-4919-40e8-9572-0ddb042ce397 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] 10.222.0.57 "GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df" status: 200 len: 1548 microversion: 2.1 time: 0.585153 Jun 30 12:35:24.863371 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 159/325] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:35:24 2022] GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df => generated 1548 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 12:35:24.880372 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-c349adfb-7ebd-475d-a543-9bac4b0a8d0f tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:35:24.883874 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-c349adfb-7ebd-475d-a543-9bac4b0a8d0f tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] [instance: d328d6c1-d49a-48c5-a26e-1ab70019f6df] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:35:24.902413 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-c349adfb-7ebd-475d-a543-9bac4b0a8d0f tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:24.906604 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-c349adfb-7ebd-475d-a543-9bac4b0a8d0f tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:24.909460 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-c349adfb-7ebd-475d-a543-9bac4b0a8d0f tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:24.910580 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-c349adfb-7ebd-475d-a543-9bac4b0a8d0f tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:25.686451 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-ad3cfda3-3f68-418e-898b-c28c9b8e27aa tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddb38b4d6864a6c96b84c9a4092eea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60d10dba1d947cc97149a063a810129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:35:25.704931 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-ad3cfda3-3f68-418e-898b-c28c9b8e27aa tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94" status: 200 len: 1722 microversion: 2.1 time: 0.942159 Jun 30 12:35:25.706385 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 167/326] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:35:24 2022] GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94 => generated 1722 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 12:35:25.782923 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-c349adfb-7ebd-475d-a543-9bac4b0a8d0f tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc65fea19f94fd18d83ad8ce3bbb476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a42d5073b0f4e4c857d794aa8d30393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:35:25.800767 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-c349adfb-7ebd-475d-a543-9bac4b0a8d0f tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] 10.222.0.57 "GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df" status: 200 len: 1548 microversion: 2.1 time: 0.925374 Jun 30 12:35:25.805414 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 160/327] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:35:24 2022] GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df => generated 1548 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 12:35:25.820428 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-96074316-17d3-41bb-b855-9a449f0537dd tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:35:25.824777 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-96074316-17d3-41bb-b855-9a449f0537dd tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1fc65fea19f94fd18d83ad8ce3bbb476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a42d5073b0f4e4c857d794aa8d30393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:35:25.827430 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-96074316-17d3-41bb-b855-9a449f0537dd tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Searching by: {'deleted': False, 'project_id': '4a42d5073b0f4e4c857d794aa8d30393'} {{(pid=124297) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 30 12:35:25.842846 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-96074316-17d3-41bb-b855-9a449f0537dd tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:25.844431 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-96074316-17d3-41bb-b855-9a449f0537dd tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:25.848037 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-96074316-17d3-41bb-b855-9a449f0537dd tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:25.848809 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-96074316-17d3-41bb-b855-9a449f0537dd tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:26.092798 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG dbcounter [-] [124297] Writing DB stats nova_cell1:SELECT=100 {{(pid=124297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:35:26.095190 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.multi_cell_list [None req-96074316-17d3-41bb-b855-9a449f0537dd tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124297) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 30 12:35:26.309100 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-96074316-17d3-41bb-b855-9a449f0537dd tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] 10.222.0.57 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.492333 Jun 30 12:35:26.315570 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 168/328] 10.222.0.57 () {58 vars in 1124 bytes} [Thu Jun 30 12:35:25 2022] GET /compute/v2.1/servers => generated 343 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:35:26.329625 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-d0a5b868-4cdb-4412-a75c-3c1bbc5c921d tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:35:26.334546 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-d0a5b868-4cdb-4412-a75c-3c1bbc5c921d tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] [instance: d328d6c1-d49a-48c5-a26e-1ab70019f6df] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:35:26.351930 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-d0a5b868-4cdb-4412-a75c-3c1bbc5c921d tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:26.353524 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-d0a5b868-4cdb-4412-a75c-3c1bbc5c921d tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:26.354530 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-d0a5b868-4cdb-4412-a75c-3c1bbc5c921d tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:26.356260 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-d0a5b868-4cdb-4412-a75c-3c1bbc5c921d tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:26.723566 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-071932a0-6e73-429d-9d80-fb80fa3be3ab tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:35:26.724297 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-071932a0-6e73-429d-9d80-fb80fa3be3ab tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 99ba3b96-6700-41e0-b2cf-ff8933b2bf94] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:35:26.736023 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-071932a0-6e73-429d-9d80-fb80fa3be3ab tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:26.747525 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-071932a0-6e73-429d-9d80-fb80fa3be3ab tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:26.749610 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-071932a0-6e73-429d-9d80-fb80fa3be3ab tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:26.750569 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-071932a0-6e73-429d-9d80-fb80fa3be3ab tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:27.077196 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-d0a5b868-4cdb-4412-a75c-3c1bbc5c921d tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc65fea19f94fd18d83ad8ce3bbb476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a42d5073b0f4e4c857d794aa8d30393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:35:27.082670 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-071932a0-6e73-429d-9d80-fb80fa3be3ab tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddb38b4d6864a6c96b84c9a4092eea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60d10dba1d947cc97149a063a810129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:35:27.091079 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-071932a0-6e73-429d-9d80-fb80fa3be3ab tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94" status: 200 len: 1722 microversion: 2.1 time: 0.372459 Jun 30 12:35:27.100618 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 169/329] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:35:26 2022] GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94 => generated 1722 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:35:27.103280 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-d0a5b868-4cdb-4412-a75c-3c1bbc5c921d tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] 10.222.0.57 "GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df" status: 200 len: 1548 microversion: 2.1 time: 0.786673 Jun 30 12:35:27.107105 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 161/330] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:35:26 2022] GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df => generated 1548 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:35:27.477519 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-f6b0326f-40c2-4263-a383-64fa2b81deb4 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Action: 'create', calling method: .version_select at 0x7fd0e02d5280>, body: {"keypair": {"name": "tempest-TestShelveInstance-612499850", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHxQAql9roZcUW1+Umx20hwXVd5+2zcBTu/vt3k+GQzbzGqtcQYeR93xL5NmIDjdoL1Jad1dIRlwYtvssjS+Pd2VUQgp5iG9e0kmt9xIfNeVTyxQZ/6wzEd8zyjxTSH3qQ=="}} {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:35:27.507478 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.quota [None req-f6b0326f-40c2-4263-a383-64fa2b81deb4 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Getting quotas for project e8abe616c14a4920b1cbc45733fa5771. Resources: {'key_pairs'} {{(pid=124297) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 12:35:27.519259 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.quota [None req-f6b0326f-40c2-4263-a383-64fa2b81deb4 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Getting quotas for user e81aa9d47cd1470abef31a27839eaf86 and project e8abe616c14a4920b1cbc45733fa5771. Resources: {'key_pairs'} {{(pid=124297) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 12:35:27.536713 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-b092d81c-f92e-411d-87e8-d3e93fd467b9 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Action: 'create', calling method: .version_select at 0x7fd0e0381310>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1101131035", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwqkvqXR+6y5JhyPDNu76iJYgfliZnp8dRiOM5FLCRlcSk6jTLp5ONM7B0nNWzwtuUqJG415UWaGDz6KJ2kcehQ6lIve3HlgKl76UvlsXmwvbbfCf5EwjfYcBDltvh/iw=="}} {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:35:27.571449 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.quota [None req-b092d81c-f92e-411d-87e8-d3e93fd467b9 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Getting quotas for project c7b272349089480984fd1c5eabe6dce9. Resources: {'key_pairs'} {{(pid=124298) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 12:35:27.576771 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.quota [None req-b092d81c-f92e-411d-87e8-d3e93fd467b9 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Getting quotas for user 72419918d6c34080b6a4a4c73b2c06b2 and project c7b272349089480984fd1c5eabe6dce9. Resources: {'key_pairs'} {{(pid=124298) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 12:35:27.625574 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-f6b0326f-40c2-4263-a383-64fa2b81deb4 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.529649 Jun 30 12:35:27.626765 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-b092d81c-f92e-411d-87e8-d3e93fd467b9 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.317145 Jun 30 12:35:27.627578 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 170/331] 10.222.0.57 () {60 vars in 1158 bytes} [Thu Jun 30 12:35:27 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:35:27.632889 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 162/332] 10.222.0.57 () {60 vars in 1158 bytes} [Thu Jun 30 12:35:27 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:35:28.111395 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-e3c9726a-d676-4d75-9ed6-191a5e63c2b9 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:35:28.112619 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-e3c9726a-d676-4d75-9ed6-191a5e63c2b9 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 99ba3b96-6700-41e0-b2cf-ff8933b2bf94] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:35:28.121211 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-e3c9726a-d676-4d75-9ed6-191a5e63c2b9 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:28.121963 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-e3c9726a-d676-4d75-9ed6-191a5e63c2b9 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:28.127491 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-e3c9726a-d676-4d75-9ed6-191a5e63c2b9 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:28.128129 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-e3c9726a-d676-4d75-9ed6-191a5e63c2b9 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:28.578287 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-e3c9726a-d676-4d75-9ed6-191a5e63c2b9 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddb38b4d6864a6c96b84c9a4092eea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60d10dba1d947cc97149a063a810129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:35:28.592428 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-e3c9726a-d676-4d75-9ed6-191a5e63c2b9 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94" status: 200 len: 1722 microversion: 2.1 time: 0.485220 Jun 30 12:35:28.593577 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 171/333] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:35:28 2022] GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94 => generated 1722 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:35:29.063988 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-c0d99c03-f90f-40b0-b79d-56d4ede9607f tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-34304831", "imageRef": "776a1662-a241-4e20-9a9c-e4743c64efd0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "62ff37ac-5e15-467a-9aa0-136aed787f31"}], "security_groups": [{"name": "tempest-securitygroup--1084634019"}], "key_name": "tempest-keypair-903132750", "user_data": "}} {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:35:29.291034 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.network.neutron [None req-c0d99c03-f90f-40b0-b79d-56d4ede9607f tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] validate_networks() for [('62ff37ac-5e15-467a-9aa0-136aed787f31', None, None, None, None, None)] {{(pid=124298) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 12:35:29.515667 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-a1be8997-e362-41e8-bd08-7b19825930ea tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "63005eb7-5c0f-4539-a9a8-78ff577cf415"}} {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:35:29.516992 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-a1be8997-e362-41e8-bd08-7b19825930ea tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] [instance: d328d6c1-d49a-48c5-a26e-1ab70019f6df] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:35:29.532605 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-a1be8997-e362-41e8-bd08-7b19825930ea tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:29.533193 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-a1be8997-e362-41e8-bd08-7b19825930ea tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:29.533840 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-a1be8997-e362-41e8-bd08-7b19825930ea tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:29.534267 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-a1be8997-e362-41e8-bd08-7b19825930ea tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:30.014265 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-a1be8997-e362-41e8-bd08-7b19825930ea tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] 10.222.0.57 "POST /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.503127 Jun 30 12:35:30.015265 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 172/334] 10.222.0.57 () {60 vars in 1322 bytes} [Thu Jun 30 12:35:29 2022] POST /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df/os-volume_attachments => generated 194 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 12:35:30.027219 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-414ebcec-f863-4ab4-a81e-da0b8ad64cff tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:35:30.028788 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-414ebcec-f863-4ab4-a81e-da0b8ad64cff tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 99ba3b96-6700-41e0-b2cf-ff8933b2bf94] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:35:30.038238 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-414ebcec-f863-4ab4-a81e-da0b8ad64cff tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:30.042060 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-414ebcec-f863-4ab4-a81e-da0b8ad64cff tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:30.043696 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-414ebcec-f863-4ab4-a81e-da0b8ad64cff tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:30.044406 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-414ebcec-f863-4ab4-a81e-da0b8ad64cff tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:30.384050 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.virt.hardware [None req-c0d99c03-f90f-40b0-b79d-56d4ede9607f tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Flavor limits 0:0:0 {{(pid=124298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 12:35:30.384550 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.virt.hardware [None req-c0d99c03-f90f-40b0-b79d-56d4ede9607f tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Image limits 0:0:0 {{(pid=124298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 12:35:30.384949 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.virt.hardware [None req-c0d99c03-f90f-40b0-b79d-56d4ede9607f tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Flavor pref 0:0:0 {{(pid=124298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 12:35:30.385350 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.virt.hardware [None req-c0d99c03-f90f-40b0-b79d-56d4ede9607f tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Image pref 0:0:0 {{(pid=124298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 12:35:30.385804 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.virt.hardware [None req-c0d99c03-f90f-40b0-b79d-56d4ede9607f tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 12:35:30.411820 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-c0d99c03-f90f-40b0-b79d-56d4ede9607f tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:30.412266 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-c0d99c03-f90f-40b0-b79d-56d4ede9607f tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:30.422346 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-414ebcec-f863-4ab4-a81e-da0b8ad64cff tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddb38b4d6864a6c96b84c9a4092eea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60d10dba1d947cc97149a063a810129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:35:30.426387 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-c0d99c03-f90f-40b0-b79d-56d4ede9607f tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:30.426840 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-c0d99c03-f90f-40b0-b79d-56d4ede9607f tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:30.433371 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-414ebcec-f863-4ab4-a81e-da0b8ad64cff tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94" status: 200 len: 1722 microversion: 2.1 time: 0.410438 Jun 30 12:35:30.433945 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 173/335] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:35:30 2022] GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94 => generated 1722 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:35:30.466038 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.quota [None req-c0d99c03-f90f-40b0-b79d-56d4ede9607f tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Getting quotas for project 663ec7a59bc147299f904d93d119c5e7. Resources: {'cores', 'ram', 'instances'} {{(pid=124298) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 12:35:30.476329 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.quota [None req-c0d99c03-f90f-40b0-b79d-56d4ede9607f tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Getting quotas for user 26807e5e7aab425eb28e781289794265 and project 663ec7a59bc147299f904d93d119c5e7. Resources: {'cores', 'ram', 'instances'} {{(pid=124298) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 12:35:30.496131 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-c0d99c03-f90f-40b0-b79d-56d4ede9607f tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Going to run 1 instances... {{(pid=124298) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 12:35:30.499545 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-c0d99c03-f90f-40b0-b79d-56d4ede9607f tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: 7f35d48f-59b1-4105-a9ea-a6ffee1b86d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='776a1662-a241-4e20-9a9c-e4743c64efd0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124298) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 12:35:30.565018 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-c0d99c03-f90f-40b0-b79d-56d4ede9607f tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.506659 Jun 30 12:35:30.565980 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 163/336] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 30 12:35:29 2022] POST /compute/v2.1/servers => generated 409 bytes in 1508 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 12:35:30.575842 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-06d7a7e7-2dd7-4151-ba08-872a16129bc3 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:35:30.577044 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-06d7a7e7-2dd7-4151-ba08-872a16129bc3 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: 7f35d48f-59b1-4105-a9ea-a6ffee1b86d0] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:35:30.649294 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-06d7a7e7-2dd7-4151-ba08-872a16129bc3 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:35:30.656162 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-06d7a7e7-2dd7-4151-ba08-872a16129bc3 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0" status: 200 len: 1243 microversion: 2.1 time: 0.084456 Jun 30 12:35:30.656778 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 174/337] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:35:30 2022] GET /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0 => generated 1243 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:35:31.454163 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-4318f32b-cd8f-450b-866a-77edc6ddf8d6 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:35:31.455090 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-4318f32b-cd8f-450b-866a-77edc6ddf8d6 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 99ba3b96-6700-41e0-b2cf-ff8933b2bf94] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:35:31.467041 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-4318f32b-cd8f-450b-866a-77edc6ddf8d6 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:31.469302 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-4318f32b-cd8f-450b-866a-77edc6ddf8d6 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:31.470404 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-4318f32b-cd8f-450b-866a-77edc6ddf8d6 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:31.471301 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-4318f32b-cd8f-450b-866a-77edc6ddf8d6 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:31.663631 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-4318f32b-cd8f-450b-866a-77edc6ddf8d6 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddb38b4d6864a6c96b84c9a4092eea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60d10dba1d947cc97149a063a810129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:35:31.674423 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-4318f32b-cd8f-450b-866a-77edc6ddf8d6 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94" status: 200 len: 1699 microversion: 2.1 time: 0.226586 Jun 30 12:35:31.675315 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 164/338] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:35:31 2022] GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94 => generated 1699 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:35:31.683534 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-1f260f4e-d088-4940-945d-2f723d5eb438 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:35:31.685063 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-1f260f4e-d088-4940-945d-2f723d5eb438 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: 7f35d48f-59b1-4105-a9ea-a6ffee1b86d0] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:35:31.692762 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-441bc859-c63e-4bbc-b9bc-ec5493706d91 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:35:31.698628 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-1f260f4e-d088-4940-945d-2f723d5eb438 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:31.703115 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-1f260f4e-d088-4940-945d-2f723d5eb438 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:31.704183 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-1f260f4e-d088-4940-945d-2f723d5eb438 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:31.704696 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-1f260f4e-d088-4940-945d-2f723d5eb438 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:31.707241 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-441bc859-c63e-4bbc-b9bc-ec5493706d91 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:31.708437 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-441bc859-c63e-4bbc-b9bc-ec5493706d91 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:31.741566 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-441bc859-c63e-4bbc-b9bc-ec5493706d91 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 99ba3b96-6700-41e0-b2cf-ff8933b2bf94] Going to try to start instance {{(pid=124298) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 30 12:35:31.775361 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-1f260f4e-d088-4940-945d-2f723d5eb438 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:35:31.784488 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-1f260f4e-d088-4940-945d-2f723d5eb438 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0" status: 200 len: 1295 microversion: 2.1 time: 0.114803 Jun 30 12:35:31.785095 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 175/339] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:35:31 2022] GET /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0 => generated 1295 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:35:31.815711 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-441bc859-c63e-4bbc-b9bc-ec5493706d91 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "POST /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94/action" status: 202 len: 0 microversion: 2.1 time: 0.126385 Jun 30 12:35:31.817108 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 165/340] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Jun 30 12:35:31 2022] POST /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 12:35:31.828025 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-a6676406-794c-4c80-85f3-029582ce7f8b tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:35:31.829777 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-a6676406-794c-4c80-85f3-029582ce7f8b tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 99ba3b96-6700-41e0-b2cf-ff8933b2bf94] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:35:31.837712 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-a6676406-794c-4c80-85f3-029582ce7f8b tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:31.838154 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-a6676406-794c-4c80-85f3-029582ce7f8b tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:31.839113 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-a6676406-794c-4c80-85f3-029582ce7f8b tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:31.839717 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-a6676406-794c-4c80-85f3-029582ce7f8b tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:32.188425 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-a6676406-794c-4c80-85f3-029582ce7f8b tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddb38b4d6864a6c96b84c9a4092eea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60d10dba1d947cc97149a063a810129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:35:32.203390 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-a6676406-794c-4c80-85f3-029582ce7f8b tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94" status: 200 len: 1708 microversion: 2.1 time: 0.381814 Jun 30 12:35:32.204404 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 176/341] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:35:31 2022] GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94 => generated 1708 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 12:35:32.804526 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-2445be2f-8860-469c-b103-79bfb9f65fca tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:35:32.805294 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-2445be2f-8860-469c-b103-79bfb9f65fca tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: 7f35d48f-59b1-4105-a9ea-a6ffee1b86d0] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:35:32.807469 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG dbcounter [-] [124298] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=4 {{(pid=124298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:35:32.813905 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-2445be2f-8860-469c-b103-79bfb9f65fca tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:32.814357 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-2445be2f-8860-469c-b103-79bfb9f65fca tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:32.815145 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-2445be2f-8860-469c-b103-79bfb9f65fca tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:32.815591 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-2445be2f-8860-469c-b103-79bfb9f65fca tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:32.832002 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG dbcounter [-] [124298] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:35:32.898691 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-2445be2f-8860-469c-b103-79bfb9f65fca tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:35:32.906920 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-2445be2f-8860-469c-b103-79bfb9f65fca tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0" status: 200 len: 1301 microversion: 2.1 time: 0.107214 Jun 30 12:35:32.907506 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 166/342] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:35:32 2022] GET /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0 => generated 1301 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:35:33.221543 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-f91be58d-a981-4b91-b842-17891fe2156d tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:35:33.222160 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-f91be58d-a981-4b91-b842-17891fe2156d tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 99ba3b96-6700-41e0-b2cf-ff8933b2bf94] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:35:33.229444 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-f91be58d-a981-4b91-b842-17891fe2156d tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:33.230093 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-f91be58d-a981-4b91-b842-17891fe2156d tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:33.230982 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-f91be58d-a981-4b91-b842-17891fe2156d tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:33.231424 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-f91be58d-a981-4b91-b842-17891fe2156d tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:33.426907 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-f91be58d-a981-4b91-b842-17891fe2156d tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddb38b4d6864a6c96b84c9a4092eea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60d10dba1d947cc97149a063a810129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:35:33.436719 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-f91be58d-a981-4b91-b842-17891fe2156d tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94" status: 200 len: 1708 microversion: 2.1 time: 0.218830 Jun 30 12:35:33.437111 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 177/343] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:35:33 2022] GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94 => generated 1708 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:35:33.924362 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-65050d88-3d3d-494b-8fa3-8bd05de2da0a tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:35:33.924999 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-65050d88-3d3d-494b-8fa3-8bd05de2da0a tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: 7f35d48f-59b1-4105-a9ea-a6ffee1b86d0] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:35:33.931817 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-65050d88-3d3d-494b-8fa3-8bd05de2da0a tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:33.932505 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-65050d88-3d3d-494b-8fa3-8bd05de2da0a tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:33.933562 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-65050d88-3d3d-494b-8fa3-8bd05de2da0a tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:33.933998 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-65050d88-3d3d-494b-8fa3-8bd05de2da0a tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:34.028057 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-65050d88-3d3d-494b-8fa3-8bd05de2da0a tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:35:34.037407 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-65050d88-3d3d-494b-8fa3-8bd05de2da0a tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0" status: 200 len: 1301 microversion: 2.1 time: 0.116780 Jun 30 12:35:34.038202 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 167/344] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:35:33 2022] GET /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0 => generated 1301 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:35:34.455717 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-2453a9f1-5543-4690-a4c1-9d644b01058c tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:35:34.456923 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-2453a9f1-5543-4690-a4c1-9d644b01058c tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 99ba3b96-6700-41e0-b2cf-ff8933b2bf94] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:35:34.480896 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-2453a9f1-5543-4690-a4c1-9d644b01058c tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:34.482548 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-2453a9f1-5543-4690-a4c1-9d644b01058c tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:34.483414 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-2453a9f1-5543-4690-a4c1-9d644b01058c tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:34.484019 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-2453a9f1-5543-4690-a4c1-9d644b01058c tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:34.893728 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-2453a9f1-5543-4690-a4c1-9d644b01058c tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddb38b4d6864a6c96b84c9a4092eea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60d10dba1d947cc97149a063a810129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:35:34.902133 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-2453a9f1-5543-4690-a4c1-9d644b01058c tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94" status: 200 len: 1708 microversion: 2.1 time: 0.451228 Jun 30 12:35:34.904644 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 178/345] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:35:34 2022] GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94 => generated 1708 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:35:35.055659 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-db8fed18-9222-466c-a0c9-36a0edc2a072 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:35:35.057166 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-db8fed18-9222-466c-a0c9-36a0edc2a072 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: 7f35d48f-59b1-4105-a9ea-a6ffee1b86d0] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:35:35.086778 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-db8fed18-9222-466c-a0c9-36a0edc2a072 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:35.091262 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-db8fed18-9222-466c-a0c9-36a0edc2a072 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:35.096886 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-db8fed18-9222-466c-a0c9-36a0edc2a072 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:35.097347 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-db8fed18-9222-466c-a0c9-36a0edc2a072 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:35.282894 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-db8fed18-9222-466c-a0c9-36a0edc2a072 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:35:35.298375 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-db8fed18-9222-466c-a0c9-36a0edc2a072 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0" status: 200 len: 1301 microversion: 2.1 time: 0.247086 Jun 30 12:35:35.302428 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 168/346] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:35:35 2022] GET /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0 => generated 1301 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:35:35.920973 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-a995a800-0dc2-494d-8c78-ac6fd3f8bbf8 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:35:35.920973 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-a995a800-0dc2-494d-8c78-ac6fd3f8bbf8 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 99ba3b96-6700-41e0-b2cf-ff8933b2bf94] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:35:35.931840 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-a995a800-0dc2-494d-8c78-ac6fd3f8bbf8 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:35.934300 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-a995a800-0dc2-494d-8c78-ac6fd3f8bbf8 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:35.936511 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-a995a800-0dc2-494d-8c78-ac6fd3f8bbf8 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:35.941024 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-a995a800-0dc2-494d-8c78-ac6fd3f8bbf8 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:35.995896 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG dbcounter [-] [124297] Writing DB stats nova_cell0:SELECT=2 {{(pid=124297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:35:36.298280 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-a995a800-0dc2-494d-8c78-ac6fd3f8bbf8 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddb38b4d6864a6c96b84c9a4092eea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60d10dba1d947cc97149a063a810129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:35:36.315566 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-9c965b5d-d90d-4d76-9f82-9ca2e745ef40 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:35:36.316823 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-9c965b5d-d90d-4d76-9f82-9ca2e745ef40 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: 7f35d48f-59b1-4105-a9ea-a6ffee1b86d0] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:35:36.326290 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-a995a800-0dc2-494d-8c78-ac6fd3f8bbf8 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94" status: 200 len: 1708 microversion: 2.1 time: 0.410625 Jun 30 12:35:36.327931 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 179/347] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:35:35 2022] GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94 => generated 1708 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:35:36.333732 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-9c965b5d-d90d-4d76-9f82-9ca2e745ef40 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:36.335069 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-9c965b5d-d90d-4d76-9f82-9ca2e745ef40 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:36.335895 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-9c965b5d-d90d-4d76-9f82-9ca2e745ef40 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:36.336432 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-9c965b5d-d90d-4d76-9f82-9ca2e745ef40 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:36.480752 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-9c965b5d-d90d-4d76-9f82-9ca2e745ef40 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:35:36.507174 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-9c965b5d-d90d-4d76-9f82-9ca2e745ef40 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0" status: 200 len: 1301 microversion: 2.1 time: 0.195465 Jun 30 12:35:36.507766 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 169/348] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:35:36 2022] GET /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0 => generated 1301 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 12:35:37.345746 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-d879089e-4eba-4045-961c-4ca0df837e38 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:35:37.347351 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-d879089e-4eba-4045-961c-4ca0df837e38 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 99ba3b96-6700-41e0-b2cf-ff8933b2bf94] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:35:37.376078 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-d879089e-4eba-4045-961c-4ca0df837e38 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:37.376961 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-d879089e-4eba-4045-961c-4ca0df837e38 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:37.379543 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-d879089e-4eba-4045-961c-4ca0df837e38 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:37.380233 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-d879089e-4eba-4045-961c-4ca0df837e38 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:37.526323 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-ce427678-e0ca-49dc-ad36-7fc94b60849f tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:35:37.527777 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-ce427678-e0ca-49dc-ad36-7fc94b60849f tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: 7f35d48f-59b1-4105-a9ea-a6ffee1b86d0] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:35:37.548257 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-ce427678-e0ca-49dc-ad36-7fc94b60849f tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:37.550213 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-ce427678-e0ca-49dc-ad36-7fc94b60849f tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:37.552464 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-ce427678-e0ca-49dc-ad36-7fc94b60849f tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:37.553932 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-ce427678-e0ca-49dc-ad36-7fc94b60849f tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:37.791529 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-d879089e-4eba-4045-961c-4ca0df837e38 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddb38b4d6864a6c96b84c9a4092eea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60d10dba1d947cc97149a063a810129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:35:37.802226 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-d879089e-4eba-4045-961c-4ca0df837e38 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94" status: 200 len: 1708 microversion: 2.1 time: 0.461034 Jun 30 12:35:37.803458 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 180/349] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:35:37 2022] GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94 => generated 1708 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:35:37.808127 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-ce427678-e0ca-49dc-ad36-7fc94b60849f tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:35:37.831589 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-ce427678-e0ca-49dc-ad36-7fc94b60849f tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0" status: 200 len: 1369 microversion: 2.1 time: 0.305592 Jun 30 12:35:37.834068 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 170/350] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:35:37 2022] GET /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0 => generated 1369 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:35:37.865629 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [req-445418c5-4a07-4306-8a3c-d1df213f0b36 req-ef30a1b3-7e4f-41e2-ab1c-0d48b53c58e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f35d48f-59b1-4105-a9ea-a6ffee1b86d0", "tag": "429c2df1-f159-4a74-afc7-610947f53fa7"}]} {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:35:37.878584 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [req-445418c5-4a07-4306-8a3c-d1df213f0b36 req-ef30a1b3-7e4f-41e2-ab1c-0d48b53c58e6 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:37.879028 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [req-445418c5-4a07-4306-8a3c-d1df213f0b36 req-ef30a1b3-7e4f-41e2-ab1c-0d48b53c58e6 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:37.899266 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.compute.server_external_events [req-445418c5-4a07-4306-8a3c-d1df213f0b36 req-ef30a1b3-7e4f-41e2-ab1c-0d48b53c58e6 service nova] Creating event network-changed:429c2df1-f159-4a74-afc7-610947f53fa7 for instance 7f35d48f-59b1-4105-a9ea-a6ffee1b86d0 on hv-cinder-84614 Jun 30 12:35:37.912194 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [req-445418c5-4a07-4306-8a3c-d1df213f0b36 req-ef30a1b3-7e4f-41e2-ab1c-0d48b53c58e6 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050101 Jun 30 12:35:37.913149 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 181/351] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 30 12:35:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:35:38.819492 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-e9e63639-62af-4d9b-a3ac-bec53583b5b3 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:35:38.820109 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-e9e63639-62af-4d9b-a3ac-bec53583b5b3 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 99ba3b96-6700-41e0-b2cf-ff8933b2bf94] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:35:38.828329 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-e9e63639-62af-4d9b-a3ac-bec53583b5b3 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:38.828800 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-e9e63639-62af-4d9b-a3ac-bec53583b5b3 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:38.829704 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-e9e63639-62af-4d9b-a3ac-bec53583b5b3 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:38.830144 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-e9e63639-62af-4d9b-a3ac-bec53583b5b3 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:38.851776 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-af81676e-5199-48ad-9878-97a1888f2472 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:35:38.852597 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-af81676e-5199-48ad-9878-97a1888f2472 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: 7f35d48f-59b1-4105-a9ea-a6ffee1b86d0] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:35:38.861376 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-af81676e-5199-48ad-9878-97a1888f2472 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:38.861824 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-af81676e-5199-48ad-9878-97a1888f2472 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:38.862606 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-af81676e-5199-48ad-9878-97a1888f2472 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:38.865645 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-af81676e-5199-48ad-9878-97a1888f2472 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:39.031771 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-e9e63639-62af-4d9b-a3ac-bec53583b5b3 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddb38b4d6864a6c96b84c9a4092eea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60d10dba1d947cc97149a063a810129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:35:39.040313 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-e9e63639-62af-4d9b-a3ac-bec53583b5b3 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94" status: 200 len: 1712 microversion: 2.1 time: 0.224808 Jun 30 12:35:39.041062 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 171/352] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:35:38 2022] GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94 => generated 1712 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:35:39.059539 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-af81676e-5199-48ad-9878-97a1888f2472 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:35:39.067760 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-af81676e-5199-48ad-9878-97a1888f2472 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0" status: 200 len: 1369 microversion: 2.1 time: 0.220754 Jun 30 12:35:39.068328 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 182/353] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:35:38 2022] GET /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0 => generated 1369 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:35:39.252831 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-210f1465-92e9-4936-a287-fe0365279140 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:35:39.252831 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-210f1465-92e9-4936-a287-fe0365279140 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] [instance: d328d6c1-d49a-48c5-a26e-1ab70019f6df] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:35:39.258928 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-210f1465-92e9-4936-a287-fe0365279140 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:39.259374 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-210f1465-92e9-4936-a287-fe0365279140 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:39.260163 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-210f1465-92e9-4936-a287-fe0365279140 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:39.260592 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-210f1465-92e9-4936-a287-fe0365279140 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:39.413873 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-210f1465-92e9-4936-a287-fe0365279140 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc65fea19f94fd18d83ad8ce3bbb476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a42d5073b0f4e4c857d794aa8d30393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:35:39.426334 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-210f1465-92e9-4936-a287-fe0365279140 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] 10.222.0.57 "GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df" status: 200 len: 1594 microversion: 2.1 time: 0.178795 Jun 30 12:35:39.426901 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 172/354] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:35:39 2022] GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df => generated 1594 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:35:40.087457 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-1c61cf99-4612-4e24-be53-78d706dd1734 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:35:40.087457 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-1c61cf99-4612-4e24-be53-78d706dd1734 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: 7f35d48f-59b1-4105-a9ea-a6ffee1b86d0] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:35:40.096593 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-1c61cf99-4612-4e24-be53-78d706dd1734 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:40.097069 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-1c61cf99-4612-4e24-be53-78d706dd1734 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:40.098150 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-1c61cf99-4612-4e24-be53-78d706dd1734 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:40.098748 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-1c61cf99-4612-4e24-be53-78d706dd1734 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:40.263845 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-1c61cf99-4612-4e24-be53-78d706dd1734 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:35:40.271432 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-1c61cf99-4612-4e24-be53-78d706dd1734 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0" status: 200 len: 1369 microversion: 2.1 time: 0.190986 Jun 30 12:35:40.272193 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 183/355] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:35:40 2022] GET /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0 => generated 1369 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:35:41.294868 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-d8da7fbd-82b8-4431-b55f-fc9436a042cb tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:35:41.298535 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-d8da7fbd-82b8-4431-b55f-fc9436a042cb tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: 7f35d48f-59b1-4105-a9ea-a6ffee1b86d0] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:35:41.301035 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG dbcounter [-] [124298] Writing DB stats nova_cell0:SELECT=2 {{(pid=124298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:35:41.301687 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG dbcounter [-] [124298] Writing DB stats nova_cell0:SELECT=10 {{(pid=124298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:35:41.323397 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-d8da7fbd-82b8-4431-b55f-fc9436a042cb tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:41.324135 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-d8da7fbd-82b8-4431-b55f-fc9436a042cb tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:41.325097 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-d8da7fbd-82b8-4431-b55f-fc9436a042cb tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:41.325679 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-d8da7fbd-82b8-4431-b55f-fc9436a042cb tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:41.536220 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-d8da7fbd-82b8-4431-b55f-fc9436a042cb tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:35:41.556224 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-d8da7fbd-82b8-4431-b55f-fc9436a042cb tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0" status: 200 len: 1369 microversion: 2.1 time: 0.271005 Jun 30 12:35:41.558396 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 173/356] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:35:41 2022] GET /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0 => generated 1369 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:35:41.780364 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [req-e5a8e234-43ab-4b5b-adc6-88a2e00d4c9d req-c48cee91-9475-419b-8613-d265ea583e26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d328d6c1-d49a-48c5-a26e-1ab70019f6df", "tag": "a04c1ee8-5a15-46b6-87ec-288a776bc842"}]} {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:35:41.790033 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG dbcounter [-] [124297] Writing DB stats nova_cell0:SELECT=10 {{(pid=124297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:35:41.795252 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [req-e5a8e234-43ab-4b5b-adc6-88a2e00d4c9d req-c48cee91-9475-419b-8613-d265ea583e26 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:41.796312 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [req-e5a8e234-43ab-4b5b-adc6-88a2e00d4c9d req-c48cee91-9475-419b-8613-d265ea583e26 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:41.813133 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.compute.server_external_events [req-e5a8e234-43ab-4b5b-adc6-88a2e00d4c9d req-c48cee91-9475-419b-8613-d265ea583e26 service nova] Creating event network-changed:a04c1ee8-5a15-46b6-87ec-288a776bc842 for instance d328d6c1-d49a-48c5-a26e-1ab70019f6df on hv-cinder-84614 Jun 30 12:35:41.821404 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [req-e5a8e234-43ab-4b5b-adc6-88a2e00d4c9d req-c48cee91-9475-419b-8613-d265ea583e26 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045880 Jun 30 12:35:41.826551 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 184/357] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 30 12:35:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:35:42.575266 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-5fcddabc-4f11-4343-82ab-1993c6aa5348 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:35:42.576767 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-5fcddabc-4f11-4343-82ab-1993c6aa5348 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: 7f35d48f-59b1-4105-a9ea-a6ffee1b86d0] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:35:42.589927 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-5fcddabc-4f11-4343-82ab-1993c6aa5348 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:42.590615 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-5fcddabc-4f11-4343-82ab-1993c6aa5348 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:42.593075 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-5fcddabc-4f11-4343-82ab-1993c6aa5348 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:42.594248 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-5fcddabc-4f11-4343-82ab-1993c6aa5348 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:42.804289 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-5fcddabc-4f11-4343-82ab-1993c6aa5348 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:35:42.818751 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-5fcddabc-4f11-4343-82ab-1993c6aa5348 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0" status: 200 len: 1369 microversion: 2.1 time: 0.247404 Jun 30 12:35:42.830480 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 174/358] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:35:42 2022] GET /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0 => generated 1369 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:35:43.111176 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [req-5a127f65-1b5c-4ea5-8e9e-b6ab91286def req-9e0dca00-83bd-4dd7-a590-a6a793bad500 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f35d48f-59b1-4105-a9ea-a6ffee1b86d0", "name": "network-vif-plugged", "status": "completed", "tag": "429c2df1-f159-4a74-afc7-610947f53fa7"}]} {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:35:43.130872 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [req-5a127f65-1b5c-4ea5-8e9e-b6ab91286def req-9e0dca00-83bd-4dd7-a590-a6a793bad500 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:43.134148 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [req-5a127f65-1b5c-4ea5-8e9e-b6ab91286def req-9e0dca00-83bd-4dd7-a590-a6a793bad500 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:43.157783 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.compute.server_external_events [req-5a127f65-1b5c-4ea5-8e9e-b6ab91286def req-9e0dca00-83bd-4dd7-a590-a6a793bad500 service nova] Creating event network-vif-plugged:429c2df1-f159-4a74-afc7-610947f53fa7 for instance 7f35d48f-59b1-4105-a9ea-a6ffee1b86d0 on hv-cinder-84614 Jun 30 12:35:43.164001 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [req-5a127f65-1b5c-4ea5-8e9e-b6ab91286def req-9e0dca00-83bd-4dd7-a590-a6a793bad500 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059451 Jun 30 12:35:43.180743 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 185/359] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 30 12:35:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:35:43.297364 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-588f0fec-01d3-4c07-a2a5-b024c8e0c644 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2030518833"}} {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:35:43.298234 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-588f0fec-01d3-4c07-a2a5-b024c8e0c644 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] [instance: d328d6c1-d49a-48c5-a26e-1ab70019f6df] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:35:43.321772 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-588f0fec-01d3-4c07-a2a5-b024c8e0c644 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:43.322073 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-588f0fec-01d3-4c07-a2a5-b024c8e0c644 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:43.323117 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-588f0fec-01d3-4c07-a2a5-b024c8e0c644 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:43.323456 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-588f0fec-01d3-4c07-a2a5-b024c8e0c644 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:43.585542 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.network.security_group_api [None req-588f0fec-01d3-4c07-a2a5-b024c8e0c644 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Adding security group 41c3fba9-c949-4730-bb0f-0d42e92706c7 to port a04c1ee8-5a15-46b6-87ec-288a776bc842 Jun 30 12:35:43.836435 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-b27b4b94-665d-48ce-aae9-9b90ff026175 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:35:43.837159 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-b27b4b94-665d-48ce-aae9-9b90ff026175 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: 7f35d48f-59b1-4105-a9ea-a6ffee1b86d0] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:35:43.849380 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG dbcounter [-] [124297] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=2 {{(pid=124297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:35:43.853071 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-b27b4b94-665d-48ce-aae9-9b90ff026175 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:43.853687 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-b27b4b94-665d-48ce-aae9-9b90ff026175 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:43.856779 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-b27b4b94-665d-48ce-aae9-9b90ff026175 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:43.857497 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-b27b4b94-665d-48ce-aae9-9b90ff026175 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:44.083647 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-b27b4b94-665d-48ce-aae9-9b90ff026175 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:35:44.096077 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-b27b4b94-665d-48ce-aae9-9b90ff026175 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0" status: 200 len: 1369 microversion: 2.1 time: 0.263274 Jun 30 12:35:44.097094 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 186/360] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:35:43 2022] GET /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0 => generated 1369 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 12:35:44.100221 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-588f0fec-01d3-4c07-a2a5-b024c8e0c644 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] 10.222.0.57 "POST /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df/action" status: 202 len: 0 microversion: 2.1 time: 0.807903 Jun 30 12:35:44.100994 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 175/361] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Jun 30 12:35:43 2022] POST /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df/action => generated 0 bytes in 809 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 12:35:44.114525 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [req-57326b22-d75c-48eb-9d80-3ce3e6efbfa5 req-d41be347-2b66-46c3-a063-f23be31841ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d328d6c1-d49a-48c5-a26e-1ab70019f6df", "tag": "a04c1ee8-5a15-46b6-87ec-288a776bc842"}]} {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:35:44.120925 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-20398d8f-f693-4c21-8456-99109a3b9a37 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:35:44.121932 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-20398d8f-f693-4c21-8456-99109a3b9a37 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] [instance: d328d6c1-d49a-48c5-a26e-1ab70019f6df] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:35:44.123524 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [req-57326b22-d75c-48eb-9d80-3ce3e6efbfa5 req-d41be347-2b66-46c3-a063-f23be31841ab service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:44.124323 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [req-57326b22-d75c-48eb-9d80-3ce3e6efbfa5 req-d41be347-2b66-46c3-a063-f23be31841ab service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:44.133107 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG dbcounter [-] [124297] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:35:44.146341 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-20398d8f-f693-4c21-8456-99109a3b9a37 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:44.146961 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-20398d8f-f693-4c21-8456-99109a3b9a37 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:44.147932 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-20398d8f-f693-4c21-8456-99109a3b9a37 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:44.149916 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-20398d8f-f693-4c21-8456-99109a3b9a37 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:44.151035 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.compute.server_external_events [req-57326b22-d75c-48eb-9d80-3ce3e6efbfa5 req-d41be347-2b66-46c3-a063-f23be31841ab service nova] Creating event network-changed:a04c1ee8-5a15-46b6-87ec-288a776bc842 for instance d328d6c1-d49a-48c5-a26e-1ab70019f6df on hv-cinder-84614 Jun 30 12:35:44.158791 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [req-57326b22-d75c-48eb-9d80-3ce3e6efbfa5 req-d41be347-2b66-46c3-a063-f23be31841ab service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051020 Jun 30 12:35:44.159871 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 187/362] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 30 12:35:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:35:44.330437 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-20398d8f-f693-4c21-8456-99109a3b9a37 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc65fea19f94fd18d83ad8ce3bbb476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a42d5073b0f4e4c857d794aa8d30393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:35:44.339707 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-20398d8f-f693-4c21-8456-99109a3b9a37 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] 10.222.0.57 "GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df" status: 200 len: 1760 microversion: 2.1 time: 0.223719 Jun 30 12:35:44.340173 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 176/363] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:35:44 2022] GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df => generated 1760 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 12:35:45.117823 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-8be8fa2f-2fc6-40aa-a4bc-6f3767bd568b tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:35:45.118515 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-8be8fa2f-2fc6-40aa-a4bc-6f3767bd568b tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: 7f35d48f-59b1-4105-a9ea-a6ffee1b86d0] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:35:45.132167 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-8be8fa2f-2fc6-40aa-a4bc-6f3767bd568b tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:45.132639 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-8be8fa2f-2fc6-40aa-a4bc-6f3767bd568b tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:45.133430 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-8be8fa2f-2fc6-40aa-a4bc-6f3767bd568b tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:45.133868 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-8be8fa2f-2fc6-40aa-a4bc-6f3767bd568b tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:45.287041 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-8be8fa2f-2fc6-40aa-a4bc-6f3767bd568b tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:35:45.295411 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-8be8fa2f-2fc6-40aa-a4bc-6f3767bd568b tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0" status: 200 len: 1563 microversion: 2.1 time: 0.181624 Jun 30 12:35:45.295991 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 188/364] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:35:45 2022] GET /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0 => generated 1563 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:35:45.312946 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-177118ef-cd9e-4329-8fe5-d41194ea2c74 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:35:45.313515 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-177118ef-cd9e-4329-8fe5-d41194ea2c74 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: 7f35d48f-59b1-4105-a9ea-a6ffee1b86d0] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:35:45.321178 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-177118ef-cd9e-4329-8fe5-d41194ea2c74 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:45.321635 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-177118ef-cd9e-4329-8fe5-d41194ea2c74 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:45.322414 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-177118ef-cd9e-4329-8fe5-d41194ea2c74 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:45.322966 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-177118ef-cd9e-4329-8fe5-d41194ea2c74 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:45.434446 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-177118ef-cd9e-4329-8fe5-d41194ea2c74 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.125859 Jun 30 12:35:45.435255 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 177/365] 10.222.0.57 () {58 vars in 1274 bytes} [Thu Jun 30 12:35:45 2022] GET /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0/os-interface => generated 284 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 12:35:46.810208 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [req-c22f883b-2178-4d65-8ee5-9d856238820f req-1b13bb75-6927-4cec-9907-8e733fa72859 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f35d48f-59b1-4105-a9ea-a6ffee1b86d0", "tag": "429c2df1-f159-4a74-afc7-610947f53fa7"}]} {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:35:46.818996 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [req-c22f883b-2178-4d65-8ee5-9d856238820f req-1b13bb75-6927-4cec-9907-8e733fa72859 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:35:46.819434 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [req-c22f883b-2178-4d65-8ee5-9d856238820f req-1b13bb75-6927-4cec-9907-8e733fa72859 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:35:46.830763 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.compute.server_external_events [req-c22f883b-2178-4d65-8ee5-9d856238820f req-1b13bb75-6927-4cec-9907-8e733fa72859 service nova] Creating event network-changed:429c2df1-f159-4a74-afc7-610947f53fa7 for instance 7f35d48f-59b1-4105-a9ea-a6ffee1b86d0 on hv-cinder-84614 Jun 30 12:35:46.835802 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [req-c22f883b-2178-4d65-8ee5-9d856238820f req-1b13bb75-6927-4cec-9907-8e733fa72859 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029484 Jun 30 12:35:46.836583 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 189/366] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 30 12:35:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:36:02.986434 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG dbcounter [-] [124298] Writing DB stats nova_api:SELECT=23 {{(pid=124298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:36:02.987632 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG dbcounter [-] [124298] Writing DB stats nova_cell1:SELECT=65 {{(pid=124298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:36:02.991578 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-0695ecd1-2a54-4de8-8361-7676ea2880db tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1046406824", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1101131035", "security_groups": [{"name": "tempest-secgroup-smoke-489166712"}], "block_device_mapping_v2": [{"uuid": "43428fcb-2ce3-4240-8672-514b1a597cab", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "060511a0-e46f-4c0e-a70d-d0864d8ba380"}]}} {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:36:03.114992 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.network.neutron [None req-0695ecd1-2a54-4de8-8361-7676ea2880db tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] validate_networks() for [('060511a0-e46f-4c0e-a70d-d0864d8ba380', None, None, None, None, None)] {{(pid=124298) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 12:36:03.498655 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.virt.hardware [None req-0695ecd1-2a54-4de8-8361-7676ea2880db tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Flavor limits 0:0:0 {{(pid=124298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 12:36:03.499085 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.virt.hardware [None req-0695ecd1-2a54-4de8-8361-7676ea2880db tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Image limits 0:0:0 {{(pid=124298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 12:36:03.499743 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.virt.hardware [None req-0695ecd1-2a54-4de8-8361-7676ea2880db tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Flavor pref 0:0:0 {{(pid=124298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 12:36:03.500288 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.virt.hardware [None req-0695ecd1-2a54-4de8-8361-7676ea2880db tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Image pref 0:0:0 {{(pid=124298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 12:36:03.500905 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.virt.hardware [None req-0695ecd1-2a54-4de8-8361-7676ea2880db tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 12:36:03.512818 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-0695ecd1-2a54-4de8-8361-7676ea2880db tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:03.513341 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-0695ecd1-2a54-4de8-8361-7676ea2880db tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:03.514144 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-0695ecd1-2a54-4de8-8361-7676ea2880db tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:03.514587 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-0695ecd1-2a54-4de8-8361-7676ea2880db tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:03.533214 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.quota [None req-0695ecd1-2a54-4de8-8361-7676ea2880db tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Getting quotas for project c7b272349089480984fd1c5eabe6dce9. Resources: {'cores', 'ram', 'instances'} {{(pid=124298) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 12:36:03.537555 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.quota [None req-0695ecd1-2a54-4de8-8361-7676ea2880db tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Getting quotas for user 72419918d6c34080b6a4a4c73b2c06b2 and project c7b272349089480984fd1c5eabe6dce9. Resources: {'cores', 'ram', 'instances'} {{(pid=124298) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 12:36:03.596790 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-0695ecd1-2a54-4de8-8361-7676ea2880db tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Going to run 1 instances... {{(pid=124298) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 12:36:03.598897 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-0695ecd1-2a54-4de8-8361-7676ea2880db tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] [instance: 42333613-46ed-4609-bb89-b0e3e7358ea0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='43428fcb-2ce3-4240-8672-514b1a597cab',volume_size=None,volume_type=None)] {{(pid=124298) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 12:36:03.736460 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-0695ecd1-2a54-4de8-8361-7676ea2880db tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.751613 Jun 30 12:36:03.737135 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 178/367] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 30 12:36:02 2022] POST /compute/v2.1/servers => generated 405 bytes in 753 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 12:36:03.745587 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG dbcounter [-] [124297] Writing DB stats nova_api:SELECT=7 {{(pid=124297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:36:03.746927 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG dbcounter [-] [124297] Writing DB stats nova_cell1:SELECT=8 {{(pid=124297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:36:03.751035 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-a81a1454-3cc4-4f92-9a54-7016c8d9e095 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:36:03.751943 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-a81a1454-3cc4-4f92-9a54-7016c8d9e095 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] [instance: 42333613-46ed-4609-bb89-b0e3e7358ea0] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:36:03.808345 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-a81a1454-3cc4-4f92-9a54-7016c8d9e095 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72419918d6c34080b6a4a4c73b2c06b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b272349089480984fd1c5eabe6dce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:36:03.815053 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-a81a1454-3cc4-4f92-9a54-7016c8d9e095 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] 10.222.0.57 "GET /compute/v2.1/servers/42333613-46ed-4609-bb89-b0e3e7358ea0" status: 200 len: 1095 microversion: 2.1 time: 0.071685 Jun 30 12:36:03.815830 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 190/368] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:36:03 2022] GET /compute/v2.1/servers/42333613-46ed-4609-bb89-b0e3e7358ea0 => generated 1095 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:36:04.729909 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-6474f427-0339-431a-abe2-24905bc8331b tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1601230419", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-612499850", "security_groups": [{"name": "tempest-secgroup-smoke-2069528831"}], "networks": [{"uuid": "c1e19503-dd37-445b-90f5-4edc5a8ae4e9"}], "block_device_mapping_v2": [{"uuid": "0fd34b69-9c92-424d-8165-4effeb95053f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:36:04.836615 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-4c3900ff-e336-49bb-8382-83a41cb113ce tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:36:04.837771 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-4c3900ff-e336-49bb-8382-83a41cb113ce tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] [instance: 42333613-46ed-4609-bb89-b0e3e7358ea0] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:36:04.849326 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-4c3900ff-e336-49bb-8382-83a41cb113ce tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:04.850054 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-4c3900ff-e336-49bb-8382-83a41cb113ce tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:04.851426 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-4c3900ff-e336-49bb-8382-83a41cb113ce tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:04.852224 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-4c3900ff-e336-49bb-8382-83a41cb113ce tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:04.864555 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.network.neutron [None req-6474f427-0339-431a-abe2-24905bc8331b tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] validate_networks() for [('c1e19503-dd37-445b-90f5-4edc5a8ae4e9', None, None, None, None, None)] {{(pid=124298) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 12:36:04.947411 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-4c3900ff-e336-49bb-8382-83a41cb113ce tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72419918d6c34080b6a4a4c73b2c06b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b272349089480984fd1c5eabe6dce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:36:04.955894 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-4c3900ff-e336-49bb-8382-83a41cb113ce tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] 10.222.0.57 "GET /compute/v2.1/servers/42333613-46ed-4609-bb89-b0e3e7358ea0" status: 200 len: 1193 microversion: 2.1 time: 0.126202 Jun 30 12:36:04.956459 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 191/369] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:36:04 2022] GET /compute/v2.1/servers/42333613-46ed-4609-bb89-b0e3e7358ea0 => generated 1193 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:36:05.334016 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.virt.hardware [None req-6474f427-0339-431a-abe2-24905bc8331b tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Flavor limits 0:0:0 {{(pid=124298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 12:36:05.334777 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.virt.hardware [None req-6474f427-0339-431a-abe2-24905bc8331b tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Image limits 0:0:0 {{(pid=124298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 12:36:05.335354 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.virt.hardware [None req-6474f427-0339-431a-abe2-24905bc8331b tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Flavor pref 0:0:0 {{(pid=124298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 12:36:05.335863 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.virt.hardware [None req-6474f427-0339-431a-abe2-24905bc8331b tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Image pref 0:0:0 {{(pid=124298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 12:36:05.336404 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.virt.hardware [None req-6474f427-0339-431a-abe2-24905bc8331b tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 12:36:05.345854 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-6474f427-0339-431a-abe2-24905bc8331b tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:05.346426 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-6474f427-0339-431a-abe2-24905bc8331b tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:05.347363 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-6474f427-0339-431a-abe2-24905bc8331b tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:05.347868 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-6474f427-0339-431a-abe2-24905bc8331b tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:05.365917 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.quota [None req-6474f427-0339-431a-abe2-24905bc8331b tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Getting quotas for project e8abe616c14a4920b1cbc45733fa5771. Resources: {'cores', 'ram', 'instances'} {{(pid=124298) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 12:36:05.371257 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.quota [None req-6474f427-0339-431a-abe2-24905bc8331b tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Getting quotas for user e81aa9d47cd1470abef31a27839eaf86 and project e8abe616c14a4920b1cbc45733fa5771. Resources: {'cores', 'ram', 'instances'} {{(pid=124298) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 12:36:05.434255 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-6474f427-0339-431a-abe2-24905bc8331b tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Going to run 1 instances... {{(pid=124298) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 12:36:05.436431 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-6474f427-0339-431a-abe2-24905bc8331b tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] [instance: 17ef4273-4c60-498a-9061-2c4fbedbafdb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0fd34b69-9c92-424d-8165-4effeb95053f',volume_size=None,volume_type=None)] {{(pid=124298) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 12:36:05.601458 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-6474f427-0339-431a-abe2-24905bc8331b tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.876202 Jun 30 12:36:05.602221 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 179/370] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 30 12:36:04 2022] POST /compute/v2.1/servers => generated 406 bytes in 878 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 12:36:05.612930 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-ad1d71ad-fe29-432a-843a-7321d51e4f13 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:36:05.615209 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-ad1d71ad-fe29-432a-843a-7321d51e4f13 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] [instance: 17ef4273-4c60-498a-9061-2c4fbedbafdb] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:36:05.677214 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-ad1d71ad-fe29-432a-843a-7321d51e4f13 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81aa9d47cd1470abef31a27839eaf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8abe616c14a4920b1cbc45733fa5771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:36:05.684942 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-ad1d71ad-fe29-432a-843a-7321d51e4f13 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] 10.222.0.57 "GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb" status: 200 len: 1088 microversion: 2.1 time: 0.076203 Jun 30 12:36:05.685668 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 192/371] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:36:05 2022] GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb => generated 1088 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:36:05.973413 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-969a5bd4-208b-496e-aed4-8705b26fa26d tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:36:05.974014 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-969a5bd4-208b-496e-aed4-8705b26fa26d tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] [instance: 42333613-46ed-4609-bb89-b0e3e7358ea0] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:36:05.981240 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-969a5bd4-208b-496e-aed4-8705b26fa26d tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:05.981680 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-969a5bd4-208b-496e-aed4-8705b26fa26d tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:05.982439 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-969a5bd4-208b-496e-aed4-8705b26fa26d tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:05.983037 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-969a5bd4-208b-496e-aed4-8705b26fa26d tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:06.051853 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-969a5bd4-208b-496e-aed4-8705b26fa26d tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72419918d6c34080b6a4a4c73b2c06b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b272349089480984fd1c5eabe6dce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:36:06.060957 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-969a5bd4-208b-496e-aed4-8705b26fa26d tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] 10.222.0.57 "GET /compute/v2.1/servers/42333613-46ed-4609-bb89-b0e3e7358ea0" status: 200 len: 1211 microversion: 2.1 time: 0.091809 Jun 30 12:36:06.061634 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 180/372] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:36:05 2022] GET /compute/v2.1/servers/42333613-46ed-4609-bb89-b0e3e7358ea0 => generated 1211 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 12:36:06.703285 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-92a9ddfb-147a-43f4-ab83-5846d64a2282 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:36:06.704017 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-92a9ddfb-147a-43f4-ab83-5846d64a2282 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] [instance: 17ef4273-4c60-498a-9061-2c4fbedbafdb] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:36:06.721601 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-92a9ddfb-147a-43f4-ab83-5846d64a2282 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:06.723029 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-92a9ddfb-147a-43f4-ab83-5846d64a2282 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:06.725266 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-92a9ddfb-147a-43f4-ab83-5846d64a2282 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:06.726664 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-92a9ddfb-147a-43f4-ab83-5846d64a2282 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:06.825431 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-92a9ddfb-147a-43f4-ab83-5846d64a2282 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81aa9d47cd1470abef31a27839eaf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8abe616c14a4920b1cbc45733fa5771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:36:06.832973 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-92a9ddfb-147a-43f4-ab83-5846d64a2282 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] 10.222.0.57 "GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb" status: 200 len: 1186 microversion: 2.1 time: 0.133621 Jun 30 12:36:06.833553 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 193/373] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:36:06 2022] GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb => generated 1186 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:36:07.078448 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-0b5fd9f5-15f4-430b-bb8a-5f5fb93424ca tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:36:07.079057 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-0b5fd9f5-15f4-430b-bb8a-5f5fb93424ca tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] [instance: 42333613-46ed-4609-bb89-b0e3e7358ea0] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:36:07.085873 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-0b5fd9f5-15f4-430b-bb8a-5f5fb93424ca tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:07.086307 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-0b5fd9f5-15f4-430b-bb8a-5f5fb93424ca tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:07.087091 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-0b5fd9f5-15f4-430b-bb8a-5f5fb93424ca tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:07.087519 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-0b5fd9f5-15f4-430b-bb8a-5f5fb93424ca tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:07.238635 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-0b5fd9f5-15f4-430b-bb8a-5f5fb93424ca tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72419918d6c34080b6a4a4c73b2c06b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b272349089480984fd1c5eabe6dce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:36:07.247393 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-0b5fd9f5-15f4-430b-bb8a-5f5fb93424ca tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] 10.222.0.57 "GET /compute/v2.1/servers/42333613-46ed-4609-bb89-b0e3e7358ea0" status: 200 len: 1266 microversion: 2.1 time: 0.172857 Jun 30 12:36:07.248017 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 181/374] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:36:07 2022] GET /compute/v2.1/servers/42333613-46ed-4609-bb89-b0e3e7358ea0 => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:36:07.809569 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [req-92763c19-a474-4899-9165-1d840653cd38 req-5bdb4e8f-e8e7-4e46-9a40-df74abf2b4b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42333613-46ed-4609-bb89-b0e3e7358ea0", "tag": "666490d7-bc72-4807-aafd-f8b8f454ed23"}]} {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:36:07.836147 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [req-92763c19-a474-4899-9165-1d840653cd38 req-5bdb4e8f-e8e7-4e46-9a40-df74abf2b4b3 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:07.840509 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [req-92763c19-a474-4899-9165-1d840653cd38 req-5bdb4e8f-e8e7-4e46-9a40-df74abf2b4b3 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:07.851689 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-dfde98e1-3c76-4c5e-a696-92a6cee58f15 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:36:07.852512 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-dfde98e1-3c76-4c5e-a696-92a6cee58f15 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] [instance: 17ef4273-4c60-498a-9061-2c4fbedbafdb] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:36:07.855630 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.compute.server_external_events [req-92763c19-a474-4899-9165-1d840653cd38 req-5bdb4e8f-e8e7-4e46-9a40-df74abf2b4b3 service nova] Creating event network-changed:666490d7-bc72-4807-aafd-f8b8f454ed23 for instance 42333613-46ed-4609-bb89-b0e3e7358ea0 on hv-cinder-84614 Jun 30 12:36:07.872212 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [req-92763c19-a474-4899-9165-1d840653cd38 req-5bdb4e8f-e8e7-4e46-9a40-df74abf2b4b3 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065802 Jun 30 12:36:07.873241 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 194/375] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 30 12:36:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:36:07.877514 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-dfde98e1-3c76-4c5e-a696-92a6cee58f15 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:07.877972 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-dfde98e1-3c76-4c5e-a696-92a6cee58f15 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:07.878773 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-dfde98e1-3c76-4c5e-a696-92a6cee58f15 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:07.879209 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-dfde98e1-3c76-4c5e-a696-92a6cee58f15 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:07.976529 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-dfde98e1-3c76-4c5e-a696-92a6cee58f15 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81aa9d47cd1470abef31a27839eaf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8abe616c14a4920b1cbc45733fa5771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:36:07.990093 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-dfde98e1-3c76-4c5e-a696-92a6cee58f15 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] 10.222.0.57 "GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb" status: 200 len: 1204 microversion: 2.1 time: 0.143094 Jun 30 12:36:07.991597 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 182/376] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:36:07 2022] GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb => generated 1204 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 12:36:08.266191 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-eabb0f7f-de5c-42b5-baf7-b915336f96d2 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:36:08.266889 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-eabb0f7f-de5c-42b5-baf7-b915336f96d2 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] [instance: 42333613-46ed-4609-bb89-b0e3e7358ea0] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:36:08.275209 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-eabb0f7f-de5c-42b5-baf7-b915336f96d2 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:08.276262 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-eabb0f7f-de5c-42b5-baf7-b915336f96d2 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:08.278206 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-eabb0f7f-de5c-42b5-baf7-b915336f96d2 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:08.279079 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-eabb0f7f-de5c-42b5-baf7-b915336f96d2 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:08.456307 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-eabb0f7f-de5c-42b5-baf7-b915336f96d2 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72419918d6c34080b6a4a4c73b2c06b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b272349089480984fd1c5eabe6dce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:36:08.465328 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-eabb0f7f-de5c-42b5-baf7-b915336f96d2 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] 10.222.0.57 "GET /compute/v2.1/servers/42333613-46ed-4609-bb89-b0e3e7358ea0" status: 200 len: 1266 microversion: 2.1 time: 0.202786 Jun 30 12:36:08.466120 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 195/377] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:36:08 2022] GET /compute/v2.1/servers/42333613-46ed-4609-bb89-b0e3e7358ea0 => generated 1266 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:36:09.013716 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-e852d077-804b-4076-a9f8-54bf02f09f0f tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:36:09.014594 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-e852d077-804b-4076-a9f8-54bf02f09f0f tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] [instance: 17ef4273-4c60-498a-9061-2c4fbedbafdb] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:36:09.023329 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-e852d077-804b-4076-a9f8-54bf02f09f0f tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:09.024085 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-e852d077-804b-4076-a9f8-54bf02f09f0f tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:09.024986 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-e852d077-804b-4076-a9f8-54bf02f09f0f tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:09.025586 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-e852d077-804b-4076-a9f8-54bf02f09f0f tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:09.194073 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-e852d077-804b-4076-a9f8-54bf02f09f0f tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81aa9d47cd1470abef31a27839eaf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8abe616c14a4920b1cbc45733fa5771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:36:09.202964 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-e852d077-804b-4076-a9f8-54bf02f09f0f tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] 10.222.0.57 "GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb" status: 200 len: 1260 microversion: 2.1 time: 0.197957 Jun 30 12:36:09.203832 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 183/378] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:36:09 2022] GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb => generated 1260 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:36:09.482871 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-28df3d96-c9c5-4a83-a39f-41111c24df41 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:36:09.483456 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-28df3d96-c9c5-4a83-a39f-41111c24df41 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] [instance: 42333613-46ed-4609-bb89-b0e3e7358ea0] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:36:09.490158 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-28df3d96-c9c5-4a83-a39f-41111c24df41 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:09.490604 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-28df3d96-c9c5-4a83-a39f-41111c24df41 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:09.491381 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-28df3d96-c9c5-4a83-a39f-41111c24df41 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:09.491804 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-28df3d96-c9c5-4a83-a39f-41111c24df41 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:09.634449 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-28df3d96-c9c5-4a83-a39f-41111c24df41 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72419918d6c34080b6a4a4c73b2c06b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b272349089480984fd1c5eabe6dce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:36:09.642442 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-28df3d96-c9c5-4a83-a39f-41111c24df41 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] 10.222.0.57 "GET /compute/v2.1/servers/42333613-46ed-4609-bb89-b0e3e7358ea0" status: 200 len: 1266 microversion: 2.1 time: 0.163640 Jun 30 12:36:09.642992 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 196/379] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:36:09 2022] GET /compute/v2.1/servers/42333613-46ed-4609-bb89-b0e3e7358ea0 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:36:09.895876 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [req-4a51a675-30f5-4114-b6a2-7ba991ccc868 req-c91e2800-8af9-4bca-8ac8-9bae13b6789f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17ef4273-4c60-498a-9061-2c4fbedbafdb", "tag": "7fb1dbc5-fce3-4c9f-bb9e-b486d232eebc"}]} {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:36:09.904462 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [req-4a51a675-30f5-4114-b6a2-7ba991ccc868 req-c91e2800-8af9-4bca-8ac8-9bae13b6789f service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:09.904939 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [req-4a51a675-30f5-4114-b6a2-7ba991ccc868 req-c91e2800-8af9-4bca-8ac8-9bae13b6789f service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:09.917258 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.compute.server_external_events [req-4a51a675-30f5-4114-b6a2-7ba991ccc868 req-c91e2800-8af9-4bca-8ac8-9bae13b6789f service nova] Creating event network-changed:7fb1dbc5-fce3-4c9f-bb9e-b486d232eebc for instance 17ef4273-4c60-498a-9061-2c4fbedbafdb on hv-cinder-84614 Jun 30 12:36:09.922483 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [req-4a51a675-30f5-4114-b6a2-7ba991ccc868 req-c91e2800-8af9-4bca-8ac8-9bae13b6789f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030303 Jun 30 12:36:09.923066 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 184/380] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 30 12:36:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:36:10.221021 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-51f93c43-8b1c-4ee8-ac5a-e81a7c919c8e tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:36:10.221689 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-51f93c43-8b1c-4ee8-ac5a-e81a7c919c8e tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] [instance: 17ef4273-4c60-498a-9061-2c4fbedbafdb] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:36:10.228331 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-51f93c43-8b1c-4ee8-ac5a-e81a7c919c8e tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:10.228824 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-51f93c43-8b1c-4ee8-ac5a-e81a7c919c8e tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:10.229596 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-51f93c43-8b1c-4ee8-ac5a-e81a7c919c8e tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:10.230133 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-51f93c43-8b1c-4ee8-ac5a-e81a7c919c8e tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:10.383114 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-51f93c43-8b1c-4ee8-ac5a-e81a7c919c8e tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81aa9d47cd1470abef31a27839eaf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8abe616c14a4920b1cbc45733fa5771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:36:10.391235 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-51f93c43-8b1c-4ee8-ac5a-e81a7c919c8e tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] 10.222.0.57 "GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb" status: 200 len: 1260 microversion: 2.1 time: 0.174127 Jun 30 12:36:10.391857 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 197/381] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:36:10 2022] GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb => generated 1260 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:36:10.660234 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-e87d7dc2-9086-4d75-bc9a-194547c2607e tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:36:10.660924 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-e87d7dc2-9086-4d75-bc9a-194547c2607e tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] [instance: 42333613-46ed-4609-bb89-b0e3e7358ea0] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:36:10.669145 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-e87d7dc2-9086-4d75-bc9a-194547c2607e tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:10.669582 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-e87d7dc2-9086-4d75-bc9a-194547c2607e tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:10.670353 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-e87d7dc2-9086-4d75-bc9a-194547c2607e tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:10.670781 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-e87d7dc2-9086-4d75-bc9a-194547c2607e tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:10.813828 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-e87d7dc2-9086-4d75-bc9a-194547c2607e tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72419918d6c34080b6a4a4c73b2c06b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b272349089480984fd1c5eabe6dce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:36:10.821894 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-e87d7dc2-9086-4d75-bc9a-194547c2607e tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] 10.222.0.57 "GET /compute/v2.1/servers/42333613-46ed-4609-bb89-b0e3e7358ea0" status: 200 len: 1266 microversion: 2.1 time: 0.166049 Jun 30 12:36:10.822759 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 185/382] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:36:10 2022] GET /compute/v2.1/servers/42333613-46ed-4609-bb89-b0e3e7358ea0 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:36:11.411901 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-25e36208-1b2d-438e-95fc-4308832c54a6 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:36:11.412530 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-25e36208-1b2d-438e-95fc-4308832c54a6 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] [instance: 17ef4273-4c60-498a-9061-2c4fbedbafdb] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:36:11.420136 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-25e36208-1b2d-438e-95fc-4308832c54a6 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:11.420620 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-25e36208-1b2d-438e-95fc-4308832c54a6 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:11.421515 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-25e36208-1b2d-438e-95fc-4308832c54a6 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:11.421988 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-25e36208-1b2d-438e-95fc-4308832c54a6 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:11.561025 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-25e36208-1b2d-438e-95fc-4308832c54a6 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81aa9d47cd1470abef31a27839eaf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8abe616c14a4920b1cbc45733fa5771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:36:11.569017 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-25e36208-1b2d-438e-95fc-4308832c54a6 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] 10.222.0.57 "GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb" status: 200 len: 1260 microversion: 2.1 time: 0.161222 Jun 30 12:36:11.569584 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 198/383] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:36:11 2022] GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:36:11.840210 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-4049520d-b2ee-4a20-8da7-8a827d1cb2d7 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:36:11.841581 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-4049520d-b2ee-4a20-8da7-8a827d1cb2d7 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] [instance: 42333613-46ed-4609-bb89-b0e3e7358ea0] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:36:11.849420 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-4049520d-b2ee-4a20-8da7-8a827d1cb2d7 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:11.849861 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-4049520d-b2ee-4a20-8da7-8a827d1cb2d7 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:11.850637 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-4049520d-b2ee-4a20-8da7-8a827d1cb2d7 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:11.851069 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-4049520d-b2ee-4a20-8da7-8a827d1cb2d7 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:11.993792 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-4049520d-b2ee-4a20-8da7-8a827d1cb2d7 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72419918d6c34080b6a4a4c73b2c06b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b272349089480984fd1c5eabe6dce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:36:12.001841 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-4049520d-b2ee-4a20-8da7-8a827d1cb2d7 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] 10.222.0.57 "GET /compute/v2.1/servers/42333613-46ed-4609-bb89-b0e3e7358ea0" status: 200 len: 1266 microversion: 2.1 time: 0.166198 Jun 30 12:36:12.002409 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 186/384] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:36:11 2022] GET /compute/v2.1/servers/42333613-46ed-4609-bb89-b0e3e7358ea0 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:36:12.586379 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-e51ff46c-c815-48c4-9c8e-77bd2a0ef333 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:36:12.587071 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-e51ff46c-c815-48c4-9c8e-77bd2a0ef333 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] [instance: 17ef4273-4c60-498a-9061-2c4fbedbafdb] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:36:12.594471 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-e51ff46c-c815-48c4-9c8e-77bd2a0ef333 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:12.594911 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-e51ff46c-c815-48c4-9c8e-77bd2a0ef333 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:12.595686 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-e51ff46c-c815-48c4-9c8e-77bd2a0ef333 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:12.596122 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-e51ff46c-c815-48c4-9c8e-77bd2a0ef333 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:12.743946 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-e51ff46c-c815-48c4-9c8e-77bd2a0ef333 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81aa9d47cd1470abef31a27839eaf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8abe616c14a4920b1cbc45733fa5771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:36:12.751985 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-e51ff46c-c815-48c4-9c8e-77bd2a0ef333 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] 10.222.0.57 "GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb" status: 200 len: 1260 microversion: 2.1 time: 0.169601 Jun 30 12:36:12.752525 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 199/385] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:36:12 2022] GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb => generated 1260 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:36:13.019680 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-5cec3794-3db1-479e-8bf1-c85bcada36a3 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:36:13.020287 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-5cec3794-3db1-479e-8bf1-c85bcada36a3 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] [instance: 42333613-46ed-4609-bb89-b0e3e7358ea0] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:36:13.027365 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-5cec3794-3db1-479e-8bf1-c85bcada36a3 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:13.027850 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-5cec3794-3db1-479e-8bf1-c85bcada36a3 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:13.028644 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-5cec3794-3db1-479e-8bf1-c85bcada36a3 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:13.029087 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-5cec3794-3db1-479e-8bf1-c85bcada36a3 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:13.168430 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-5cec3794-3db1-479e-8bf1-c85bcada36a3 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72419918d6c34080b6a4a4c73b2c06b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b272349089480984fd1c5eabe6dce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:36:13.178499 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-5cec3794-3db1-479e-8bf1-c85bcada36a3 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] 10.222.0.57 "GET /compute/v2.1/servers/42333613-46ed-4609-bb89-b0e3e7358ea0" status: 200 len: 1266 microversion: 2.1 time: 0.162792 Jun 30 12:36:13.179093 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 187/386] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:36:13 2022] GET /compute/v2.1/servers/42333613-46ed-4609-bb89-b0e3e7358ea0 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:36:13.773819 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-aef6a53c-273f-4379-84e5-2d1993105373 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:36:13.774574 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-aef6a53c-273f-4379-84e5-2d1993105373 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] [instance: 17ef4273-4c60-498a-9061-2c4fbedbafdb] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:36:13.784606 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-aef6a53c-273f-4379-84e5-2d1993105373 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:13.785091 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-aef6a53c-273f-4379-84e5-2d1993105373 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:13.785885 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-aef6a53c-273f-4379-84e5-2d1993105373 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:13.786323 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-aef6a53c-273f-4379-84e5-2d1993105373 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:13.931837 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-aef6a53c-273f-4379-84e5-2d1993105373 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81aa9d47cd1470abef31a27839eaf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8abe616c14a4920b1cbc45733fa5771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:36:13.939919 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-aef6a53c-273f-4379-84e5-2d1993105373 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] 10.222.0.57 "GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb" status: 200 len: 1260 microversion: 2.1 time: 0.171440 Jun 30 12:36:13.940748 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 200/387] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:36:13 2022] GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb => generated 1260 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:36:14.196802 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-25f3ab57-a7ab-42dc-b99a-368f94b80288 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:36:14.197418 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-25f3ab57-a7ab-42dc-b99a-368f94b80288 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] [instance: 42333613-46ed-4609-bb89-b0e3e7358ea0] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:36:14.204732 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-25f3ab57-a7ab-42dc-b99a-368f94b80288 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:14.205341 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-25f3ab57-a7ab-42dc-b99a-368f94b80288 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:14.206112 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-25f3ab57-a7ab-42dc-b99a-368f94b80288 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:14.206552 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-25f3ab57-a7ab-42dc-b99a-368f94b80288 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:14.349664 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-25f3ab57-a7ab-42dc-b99a-368f94b80288 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72419918d6c34080b6a4a4c73b2c06b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b272349089480984fd1c5eabe6dce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:36:14.357735 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-25f3ab57-a7ab-42dc-b99a-368f94b80288 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] 10.222.0.57 "GET /compute/v2.1/servers/42333613-46ed-4609-bb89-b0e3e7358ea0" status: 200 len: 1266 microversion: 2.1 time: 0.165237 Jun 30 12:36:14.358308 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 188/388] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:36:14 2022] GET /compute/v2.1/servers/42333613-46ed-4609-bb89-b0e3e7358ea0 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:36:14.957503 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-36382f58-1113-46fd-9c5a-14dda55e0808 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:36:14.958098 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-36382f58-1113-46fd-9c5a-14dda55e0808 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] [instance: 17ef4273-4c60-498a-9061-2c4fbedbafdb] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:36:14.965277 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-36382f58-1113-46fd-9c5a-14dda55e0808 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:14.965677 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-36382f58-1113-46fd-9c5a-14dda55e0808 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:14.966417 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-36382f58-1113-46fd-9c5a-14dda55e0808 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:14.966843 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-36382f58-1113-46fd-9c5a-14dda55e0808 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:15.109857 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-36382f58-1113-46fd-9c5a-14dda55e0808 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81aa9d47cd1470abef31a27839eaf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8abe616c14a4920b1cbc45733fa5771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:36:15.117756 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-36382f58-1113-46fd-9c5a-14dda55e0808 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] 10.222.0.57 "GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb" status: 200 len: 1260 microversion: 2.1 time: 0.164306 Jun 30 12:36:15.118329 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 201/389] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:36:14 2022] GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb => generated 1260 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:36:15.376067 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-b89378d5-9c11-44f6-9677-9cc4bd61feb0 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:36:15.376689 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-b89378d5-9c11-44f6-9677-9cc4bd61feb0 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] [instance: 42333613-46ed-4609-bb89-b0e3e7358ea0] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:36:15.379018 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG dbcounter [-] [124298] Writing DB stats nova_cell0:SELECT=4 {{(pid=124298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:36:15.380843 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG dbcounter [-] [124298] Writing DB stats nova_cell0:SELECT=12 {{(pid=124298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:36:15.385285 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-b89378d5-9c11-44f6-9677-9cc4bd61feb0 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:15.385730 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-b89378d5-9c11-44f6-9677-9cc4bd61feb0 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:15.386492 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-b89378d5-9c11-44f6-9677-9cc4bd61feb0 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:15.386948 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-b89378d5-9c11-44f6-9677-9cc4bd61feb0 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:15.526038 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-b89378d5-9c11-44f6-9677-9cc4bd61feb0 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72419918d6c34080b6a4a4c73b2c06b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b272349089480984fd1c5eabe6dce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:36:15.536451 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-b89378d5-9c11-44f6-9677-9cc4bd61feb0 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] 10.222.0.57 "GET /compute/v2.1/servers/42333613-46ed-4609-bb89-b0e3e7358ea0" status: 200 len: 1266 microversion: 2.1 time: 0.164107 Jun 30 12:36:15.537195 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 189/390] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:36:15 2022] GET /compute/v2.1/servers/42333613-46ed-4609-bb89-b0e3e7358ea0 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 12:36:16.132672 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG dbcounter [-] [124297] Writing DB stats nova_cell0:SELECT=4 {{(pid=124297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:36:16.139439 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-279faa2c-5c9d-4030-a868-4466b8657763 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:36:16.140140 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-279faa2c-5c9d-4030-a868-4466b8657763 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] [instance: 17ef4273-4c60-498a-9061-2c4fbedbafdb] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:36:16.146723 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-279faa2c-5c9d-4030-a868-4466b8657763 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:16.147164 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-279faa2c-5c9d-4030-a868-4466b8657763 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:16.147930 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-279faa2c-5c9d-4030-a868-4466b8657763 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:16.148379 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-279faa2c-5c9d-4030-a868-4466b8657763 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:16.288620 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-279faa2c-5c9d-4030-a868-4466b8657763 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81aa9d47cd1470abef31a27839eaf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8abe616c14a4920b1cbc45733fa5771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:36:16.296888 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-279faa2c-5c9d-4030-a868-4466b8657763 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] 10.222.0.57 "GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb" status: 200 len: 1260 microversion: 2.1 time: 0.165465 Jun 30 12:36:16.297458 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 202/391] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:36:16 2022] GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:36:16.558980 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-810495ea-aa9e-4e9c-975d-fada13882ac5 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:36:16.559581 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-810495ea-aa9e-4e9c-975d-fada13882ac5 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] [instance: 42333613-46ed-4609-bb89-b0e3e7358ea0] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:36:16.566367 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-810495ea-aa9e-4e9c-975d-fada13882ac5 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:16.566817 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-810495ea-aa9e-4e9c-975d-fada13882ac5 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:16.567584 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-810495ea-aa9e-4e9c-975d-fada13882ac5 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:16.568018 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-810495ea-aa9e-4e9c-975d-fada13882ac5 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:16.712873 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-810495ea-aa9e-4e9c-975d-fada13882ac5 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72419918d6c34080b6a4a4c73b2c06b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b272349089480984fd1c5eabe6dce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:36:16.720772 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-810495ea-aa9e-4e9c-975d-fada13882ac5 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] 10.222.0.57 "GET /compute/v2.1/servers/42333613-46ed-4609-bb89-b0e3e7358ea0" status: 200 len: 1266 microversion: 2.1 time: 0.165796 Jun 30 12:36:16.721451 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 190/392] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:36:16 2022] GET /compute/v2.1/servers/42333613-46ed-4609-bb89-b0e3e7358ea0 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:36:17.315165 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-bb840eb3-36be-42a3-9744-be7d6f944ccd tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:36:17.315789 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-bb840eb3-36be-42a3-9744-be7d6f944ccd tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] [instance: 17ef4273-4c60-498a-9061-2c4fbedbafdb] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:36:17.325972 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-bb840eb3-36be-42a3-9744-be7d6f944ccd tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:17.326469 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-bb840eb3-36be-42a3-9744-be7d6f944ccd tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:17.327521 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-bb840eb3-36be-42a3-9744-be7d6f944ccd tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:17.328188 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-bb840eb3-36be-42a3-9744-be7d6f944ccd tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:17.482922 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-bb840eb3-36be-42a3-9744-be7d6f944ccd tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81aa9d47cd1470abef31a27839eaf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8abe616c14a4920b1cbc45733fa5771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:36:17.491689 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-bb840eb3-36be-42a3-9744-be7d6f944ccd tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] 10.222.0.57 "GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb" status: 200 len: 1260 microversion: 2.1 time: 0.180280 Jun 30 12:36:17.492293 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 203/393] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:36:17 2022] GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb => generated 1260 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:36:17.741915 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-ca99a09e-8aa7-4fee-bacd-327bafaf73cb tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:36:17.742590 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-ca99a09e-8aa7-4fee-bacd-327bafaf73cb tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] [instance: 42333613-46ed-4609-bb89-b0e3e7358ea0] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:36:17.749999 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-ca99a09e-8aa7-4fee-bacd-327bafaf73cb tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:17.750447 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-ca99a09e-8aa7-4fee-bacd-327bafaf73cb tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:17.751450 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-ca99a09e-8aa7-4fee-bacd-327bafaf73cb tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:17.751884 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-ca99a09e-8aa7-4fee-bacd-327bafaf73cb tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:17.894197 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-ca99a09e-8aa7-4fee-bacd-327bafaf73cb tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72419918d6c34080b6a4a4c73b2c06b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b272349089480984fd1c5eabe6dce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:36:17.902480 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-ca99a09e-8aa7-4fee-bacd-327bafaf73cb tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] 10.222.0.57 "GET /compute/v2.1/servers/42333613-46ed-4609-bb89-b0e3e7358ea0" status: 200 len: 1266 microversion: 2.1 time: 0.165704 Jun 30 12:36:17.903053 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 191/394] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:36:17 2022] GET /compute/v2.1/servers/42333613-46ed-4609-bb89-b0e3e7358ea0 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:36:18.509662 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-653b185f-b74e-4b14-82d0-3eb3b8418f39 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:36:18.510266 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-653b185f-b74e-4b14-82d0-3eb3b8418f39 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] [instance: 17ef4273-4c60-498a-9061-2c4fbedbafdb] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:36:18.517410 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-653b185f-b74e-4b14-82d0-3eb3b8418f39 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:18.517858 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-653b185f-b74e-4b14-82d0-3eb3b8418f39 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:18.518639 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-653b185f-b74e-4b14-82d0-3eb3b8418f39 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:18.519060 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-653b185f-b74e-4b14-82d0-3eb3b8418f39 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:18.654689 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-653b185f-b74e-4b14-82d0-3eb3b8418f39 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81aa9d47cd1470abef31a27839eaf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8abe616c14a4920b1cbc45733fa5771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:36:18.666920 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-653b185f-b74e-4b14-82d0-3eb3b8418f39 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] 10.222.0.57 "GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb" status: 200 len: 1260 microversion: 2.1 time: 0.161319 Jun 30 12:36:18.667702 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 204/395] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:36:18 2022] GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:36:18.920009 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-837631bf-33a1-4ba3-9a51-32f4efdd46cf tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:36:18.920615 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-837631bf-33a1-4ba3-9a51-32f4efdd46cf tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] [instance: 42333613-46ed-4609-bb89-b0e3e7358ea0] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:36:18.927904 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-837631bf-33a1-4ba3-9a51-32f4efdd46cf tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:18.928409 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-837631bf-33a1-4ba3-9a51-32f4efdd46cf tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:18.929267 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-837631bf-33a1-4ba3-9a51-32f4efdd46cf tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:18.929706 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-837631bf-33a1-4ba3-9a51-32f4efdd46cf tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:19.071426 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-837631bf-33a1-4ba3-9a51-32f4efdd46cf tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72419918d6c34080b6a4a4c73b2c06b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b272349089480984fd1c5eabe6dce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:36:19.079102 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-837631bf-33a1-4ba3-9a51-32f4efdd46cf tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] 10.222.0.57 "GET /compute/v2.1/servers/42333613-46ed-4609-bb89-b0e3e7358ea0" status: 200 len: 1266 microversion: 2.1 time: 0.163393 Jun 30 12:36:19.079713 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 192/396] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:36:18 2022] GET /compute/v2.1/servers/42333613-46ed-4609-bb89-b0e3e7358ea0 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:36:19.691219 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-1cb39073-d640-43fe-b704-46f051acc204 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:36:19.692173 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-1cb39073-d640-43fe-b704-46f051acc204 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] [instance: 17ef4273-4c60-498a-9061-2c4fbedbafdb] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:36:19.699807 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-1cb39073-d640-43fe-b704-46f051acc204 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:19.700254 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-1cb39073-d640-43fe-b704-46f051acc204 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:19.701119 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-1cb39073-d640-43fe-b704-46f051acc204 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:19.701496 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-1cb39073-d640-43fe-b704-46f051acc204 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:19.833592 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-1cb39073-d640-43fe-b704-46f051acc204 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81aa9d47cd1470abef31a27839eaf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8abe616c14a4920b1cbc45733fa5771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:36:19.842241 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-1cb39073-d640-43fe-b704-46f051acc204 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] 10.222.0.57 "GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb" status: 200 len: 1260 microversion: 2.1 time: 0.157465 Jun 30 12:36:19.842804 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 205/397] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:36:19 2022] GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:36:20.096351 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-f4e42657-9949-4db7-a66d-852ba02f3dd9 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:36:20.096991 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-f4e42657-9949-4db7-a66d-852ba02f3dd9 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] [instance: 42333613-46ed-4609-bb89-b0e3e7358ea0] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:36:20.105291 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-f4e42657-9949-4db7-a66d-852ba02f3dd9 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:20.105686 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-f4e42657-9949-4db7-a66d-852ba02f3dd9 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:20.106587 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-f4e42657-9949-4db7-a66d-852ba02f3dd9 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:20.106882 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-f4e42657-9949-4db7-a66d-852ba02f3dd9 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:20.221495 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [req-4293f539-6d52-482c-91f3-2c605f3e5ac2 req-1bc39929-b0c9-4702-8785-10f637d8bb77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42333613-46ed-4609-bb89-b0e3e7358ea0", "name": "network-vif-plugged", "status": "completed", "tag": "666490d7-bc72-4807-aafd-f8b8f454ed23"}]} {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:36:20.230953 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [req-4293f539-6d52-482c-91f3-2c605f3e5ac2 req-1bc39929-b0c9-4702-8785-10f637d8bb77 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:20.231502 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [req-4293f539-6d52-482c-91f3-2c605f3e5ac2 req-1bc39929-b0c9-4702-8785-10f637d8bb77 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:20.243609 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-f4e42657-9949-4db7-a66d-852ba02f3dd9 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72419918d6c34080b6a4a4c73b2c06b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b272349089480984fd1c5eabe6dce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:36:20.246865 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.compute.server_external_events [req-4293f539-6d52-482c-91f3-2c605f3e5ac2 req-1bc39929-b0c9-4702-8785-10f637d8bb77 service nova] Creating event network-vif-plugged:666490d7-bc72-4807-aafd-f8b8f454ed23 for instance 42333613-46ed-4609-bb89-b0e3e7358ea0 on hv-cinder-84614 Jun 30 12:36:20.251644 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-f4e42657-9949-4db7-a66d-852ba02f3dd9 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] 10.222.0.57 "GET /compute/v2.1/servers/42333613-46ed-4609-bb89-b0e3e7358ea0" status: 200 len: 1266 microversion: 2.1 time: 0.160205 Jun 30 12:36:20.252164 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [req-4293f539-6d52-482c-91f3-2c605f3e5ac2 req-1bc39929-b0c9-4702-8785-10f637d8bb77 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036469 Jun 30 12:36:20.252300 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 193/398] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:36:20 2022] GET /compute/v2.1/servers/42333613-46ed-4609-bb89-b0e3e7358ea0 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:36:20.253402 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 206/399] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 30 12:36:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:36:20.861976 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-43b3fe01-f003-4ce6-94a3-dc8bd3ce7b86 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:36:20.862565 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-43b3fe01-f003-4ce6-94a3-dc8bd3ce7b86 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] [instance: 17ef4273-4c60-498a-9061-2c4fbedbafdb] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:36:20.870437 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-43b3fe01-f003-4ce6-94a3-dc8bd3ce7b86 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:20.870884 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-43b3fe01-f003-4ce6-94a3-dc8bd3ce7b86 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:20.871647 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-43b3fe01-f003-4ce6-94a3-dc8bd3ce7b86 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:20.872083 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-43b3fe01-f003-4ce6-94a3-dc8bd3ce7b86 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:21.011624 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-43b3fe01-f003-4ce6-94a3-dc8bd3ce7b86 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81aa9d47cd1470abef31a27839eaf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8abe616c14a4920b1cbc45733fa5771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:36:21.019467 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-43b3fe01-f003-4ce6-94a3-dc8bd3ce7b86 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] 10.222.0.57 "GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb" status: 200 len: 1260 microversion: 2.1 time: 0.163876 Jun 30 12:36:21.020034 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 194/400] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:36:20 2022] GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:36:21.270403 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-03179c1a-6859-4b02-a19e-c4dae09efea3 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:36:21.271266 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-03179c1a-6859-4b02-a19e-c4dae09efea3 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] [instance: 42333613-46ed-4609-bb89-b0e3e7358ea0] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:36:21.280347 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-03179c1a-6859-4b02-a19e-c4dae09efea3 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:21.280959 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-03179c1a-6859-4b02-a19e-c4dae09efea3 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:21.281921 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-03179c1a-6859-4b02-a19e-c4dae09efea3 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:21.282468 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-03179c1a-6859-4b02-a19e-c4dae09efea3 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:21.426127 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-03179c1a-6859-4b02-a19e-c4dae09efea3 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72419918d6c34080b6a4a4c73b2c06b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b272349089480984fd1c5eabe6dce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:36:21.434296 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-03179c1a-6859-4b02-a19e-c4dae09efea3 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] 10.222.0.57 "GET /compute/v2.1/servers/42333613-46ed-4609-bb89-b0e3e7358ea0" status: 200 len: 1266 microversion: 2.1 time: 0.169145 Jun 30 12:36:21.434804 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 207/401] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:36:21 2022] GET /compute/v2.1/servers/42333613-46ed-4609-bb89-b0e3e7358ea0 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:36:22.040429 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-d10c1d3a-dc19-4bf0-9ca1-260681486fd9 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:36:22.041448 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-d10c1d3a-dc19-4bf0-9ca1-260681486fd9 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] [instance: 17ef4273-4c60-498a-9061-2c4fbedbafdb] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:36:22.048438 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-d10c1d3a-dc19-4bf0-9ca1-260681486fd9 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:22.048918 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-d10c1d3a-dc19-4bf0-9ca1-260681486fd9 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:22.049699 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-d10c1d3a-dc19-4bf0-9ca1-260681486fd9 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:22.050101 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-d10c1d3a-dc19-4bf0-9ca1-260681486fd9 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:22.193439 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-d10c1d3a-dc19-4bf0-9ca1-260681486fd9 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81aa9d47cd1470abef31a27839eaf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8abe616c14a4920b1cbc45733fa5771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:36:22.201498 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-d10c1d3a-dc19-4bf0-9ca1-260681486fd9 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] 10.222.0.57 "GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb" status: 200 len: 1260 microversion: 2.1 time: 0.167196 Jun 30 12:36:22.202066 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 195/402] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:36:22 2022] GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb => generated 1260 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:36:22.290580 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [req-294c5b4f-8867-45bc-96e0-52a86286215a req-04a79a55-bf9e-4579-aa58-5cabf76d6f1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17ef4273-4c60-498a-9061-2c4fbedbafdb", "name": "network-vif-plugged", "status": "completed", "tag": "7fb1dbc5-fce3-4c9f-bb9e-b486d232eebc"}]} {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:36:22.305460 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [req-294c5b4f-8867-45bc-96e0-52a86286215a req-04a79a55-bf9e-4579-aa58-5cabf76d6f1f service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:22.305903 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [req-294c5b4f-8867-45bc-96e0-52a86286215a req-04a79a55-bf9e-4579-aa58-5cabf76d6f1f service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:22.317217 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.compute.server_external_events [req-294c5b4f-8867-45bc-96e0-52a86286215a req-04a79a55-bf9e-4579-aa58-5cabf76d6f1f service nova] Creating event network-vif-plugged:7fb1dbc5-fce3-4c9f-bb9e-b486d232eebc for instance 17ef4273-4c60-498a-9061-2c4fbedbafdb on hv-cinder-84614 Jun 30 12:36:22.322368 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [req-294c5b4f-8867-45bc-96e0-52a86286215a req-04a79a55-bf9e-4579-aa58-5cabf76d6f1f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038066 Jun 30 12:36:22.322935 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 208/403] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 30 12:36:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:36:22.455502 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-3ec9d1a1-a9fa-4fb5-afe2-48e5b61a2a64 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:36:22.456140 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-3ec9d1a1-a9fa-4fb5-afe2-48e5b61a2a64 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] [instance: 42333613-46ed-4609-bb89-b0e3e7358ea0] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:36:22.462797 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-3ec9d1a1-a9fa-4fb5-afe2-48e5b61a2a64 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:22.463247 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-3ec9d1a1-a9fa-4fb5-afe2-48e5b61a2a64 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:22.464009 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-3ec9d1a1-a9fa-4fb5-afe2-48e5b61a2a64 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:22.464446 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-3ec9d1a1-a9fa-4fb5-afe2-48e5b61a2a64 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:22.482827 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG dbcounter [-] [124298] Writing DB stats nova_cell1:SELECT=100 {{(pid=124298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:36:22.604322 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-3ec9d1a1-a9fa-4fb5-afe2-48e5b61a2a64 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72419918d6c34080b6a4a4c73b2c06b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b272349089480984fd1c5eabe6dce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:36:22.612539 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-3ec9d1a1-a9fa-4fb5-afe2-48e5b61a2a64 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] 10.222.0.57 "GET /compute/v2.1/servers/42333613-46ed-4609-bb89-b0e3e7358ea0" status: 200 len: 1266 microversion: 2.1 time: 0.160976 Jun 30 12:36:22.613126 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 196/404] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:36:22 2022] GET /compute/v2.1/servers/42333613-46ed-4609-bb89-b0e3e7358ea0 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:36:23.218469 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-6676041b-5fff-4b69-a12e-782aed32b4fb tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:36:23.219163 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-6676041b-5fff-4b69-a12e-782aed32b4fb tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] [instance: 17ef4273-4c60-498a-9061-2c4fbedbafdb] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:36:23.225468 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-6676041b-5fff-4b69-a12e-782aed32b4fb tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:23.225910 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-6676041b-5fff-4b69-a12e-782aed32b4fb tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:23.226809 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-6676041b-5fff-4b69-a12e-782aed32b4fb tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:23.227326 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-6676041b-5fff-4b69-a12e-782aed32b4fb tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:23.375685 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-6676041b-5fff-4b69-a12e-782aed32b4fb tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81aa9d47cd1470abef31a27839eaf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8abe616c14a4920b1cbc45733fa5771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:36:23.383481 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-6676041b-5fff-4b69-a12e-782aed32b4fb tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] 10.222.0.57 "GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb" status: 200 len: 1260 microversion: 2.1 time: 0.169295 Jun 30 12:36:23.384052 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 209/405] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:36:23 2022] GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb => generated 1260 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:36:23.630546 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-c9b7203b-0aa7-4c8e-bd92-e18cf6a53940 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:36:23.631158 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-c9b7203b-0aa7-4c8e-bd92-e18cf6a53940 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] [instance: 42333613-46ed-4609-bb89-b0e3e7358ea0] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:36:23.637869 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-c9b7203b-0aa7-4c8e-bd92-e18cf6a53940 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:23.638501 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-c9b7203b-0aa7-4c8e-bd92-e18cf6a53940 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:23.639280 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-c9b7203b-0aa7-4c8e-bd92-e18cf6a53940 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:23.639715 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-c9b7203b-0aa7-4c8e-bd92-e18cf6a53940 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:23.790355 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-c9b7203b-0aa7-4c8e-bd92-e18cf6a53940 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72419918d6c34080b6a4a4c73b2c06b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b272349089480984fd1c5eabe6dce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:36:23.802535 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-c9b7203b-0aa7-4c8e-bd92-e18cf6a53940 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] 10.222.0.57 "GET /compute/v2.1/servers/42333613-46ed-4609-bb89-b0e3e7358ea0" status: 200 len: 1452 microversion: 2.1 time: 0.176374 Jun 30 12:36:23.803346 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 197/406] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:36:23 2022] GET /compute/v2.1/servers/42333613-46ed-4609-bb89-b0e3e7358ea0 => generated 1452 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:36:23.825368 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-3b69225d-bd60-4c77-b945-0d4823375af1 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:36:23.825969 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-3b69225d-bd60-4c77-b945-0d4823375af1 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] [instance: 42333613-46ed-4609-bb89-b0e3e7358ea0] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:36:23.832389 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-3b69225d-bd60-4c77-b945-0d4823375af1 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:23.832880 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-3b69225d-bd60-4c77-b945-0d4823375af1 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:23.833657 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-3b69225d-bd60-4c77-b945-0d4823375af1 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:23.834082 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-3b69225d-bd60-4c77-b945-0d4823375af1 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:23.854190 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG dbcounter [-] [124297] Writing DB stats nova_cell1:SELECT=100 {{(pid=124297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:36:23.989088 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-3b69225d-bd60-4c77-b945-0d4823375af1 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72419918d6c34080b6a4a4c73b2c06b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b272349089480984fd1c5eabe6dce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:36:24.001413 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-3b69225d-bd60-4c77-b945-0d4823375af1 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] 10.222.0.57 "GET /compute/v2.1/servers/42333613-46ed-4609-bb89-b0e3e7358ea0" status: 200 len: 1452 microversion: 2.1 time: 0.179581 Jun 30 12:36:24.002250 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 210/407] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:36:23 2022] GET /compute/v2.1/servers/42333613-46ed-4609-bb89-b0e3e7358ea0 => generated 1452 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:36:24.400931 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-61520f38-5f87-4486-bf94-84a25a1c8447 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:36:24.401536 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-61520f38-5f87-4486-bf94-84a25a1c8447 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] [instance: 17ef4273-4c60-498a-9061-2c4fbedbafdb] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:36:24.407867 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-61520f38-5f87-4486-bf94-84a25a1c8447 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:24.408364 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-61520f38-5f87-4486-bf94-84a25a1c8447 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:24.409166 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-61520f38-5f87-4486-bf94-84a25a1c8447 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:24.409635 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-61520f38-5f87-4486-bf94-84a25a1c8447 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:24.603739 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-61520f38-5f87-4486-bf94-84a25a1c8447 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81aa9d47cd1470abef31a27839eaf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8abe616c14a4920b1cbc45733fa5771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:36:24.611675 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-61520f38-5f87-4486-bf94-84a25a1c8447 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] 10.222.0.57 "GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb" status: 200 len: 1260 microversion: 2.1 time: 0.214982 Jun 30 12:36:24.612241 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 198/408] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:36:24 2022] GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb => generated 1260 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:36:24.758263 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-c513b862-7d1b-4050-98f6-e60641f32d7f tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:36:24.759279 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-c513b862-7d1b-4050-98f6-e60641f32d7f tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] [instance: d328d6c1-d49a-48c5-a26e-1ab70019f6df] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:36:24.765609 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-c513b862-7d1b-4050-98f6-e60641f32d7f tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:24.765999 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-c513b862-7d1b-4050-98f6-e60641f32d7f tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:24.766775 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-c513b862-7d1b-4050-98f6-e60641f32d7f tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:24.767192 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-c513b862-7d1b-4050-98f6-e60641f32d7f tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:24.862406 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-c513b862-7d1b-4050-98f6-e60641f32d7f tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] 10.222.0.57 "POST /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df/action" status: 202 len: 0 microversion: 2.1 time: 0.108204 Jun 30 12:36:24.863155 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 211/409] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Jun 30 12:36:24 2022] POST /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 12:36:24.873728 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-3d0eb465-437a-40f3-9250-d82f325011cd tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:36:24.874427 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-3d0eb465-437a-40f3-9250-d82f325011cd tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] [instance: d328d6c1-d49a-48c5-a26e-1ab70019f6df] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:36:24.880757 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-3d0eb465-437a-40f3-9250-d82f325011cd tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:24.881267 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-3d0eb465-437a-40f3-9250-d82f325011cd tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:24.882336 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-3d0eb465-437a-40f3-9250-d82f325011cd tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:24.882992 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-3d0eb465-437a-40f3-9250-d82f325011cd tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:25.217154 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-3d0eb465-437a-40f3-9250-d82f325011cd tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc65fea19f94fd18d83ad8ce3bbb476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a42d5073b0f4e4c857d794aa8d30393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:36:25.225635 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-3d0eb465-437a-40f3-9250-d82f325011cd tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] 10.222.0.57 "GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df" status: 200 len: 1752 microversion: 2.1 time: 0.357339 Jun 30 12:36:25.226283 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 199/410] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:36:24 2022] GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df => generated 1752 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:36:25.630344 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-c85bc46b-bbf5-4110-9ec5-1b656dd98a97 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:36:25.631156 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-c85bc46b-bbf5-4110-9ec5-1b656dd98a97 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] [instance: 17ef4273-4c60-498a-9061-2c4fbedbafdb] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:36:25.639545 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-c85bc46b-bbf5-4110-9ec5-1b656dd98a97 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:25.640201 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-c85bc46b-bbf5-4110-9ec5-1b656dd98a97 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:25.641019 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-c85bc46b-bbf5-4110-9ec5-1b656dd98a97 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:25.641460 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-c85bc46b-bbf5-4110-9ec5-1b656dd98a97 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:25.872125 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-c85bc46b-bbf5-4110-9ec5-1b656dd98a97 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81aa9d47cd1470abef31a27839eaf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8abe616c14a4920b1cbc45733fa5771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:36:25.881902 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-c85bc46b-bbf5-4110-9ec5-1b656dd98a97 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] 10.222.0.57 "GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb" status: 200 len: 1444 microversion: 2.1 time: 0.256609 Jun 30 12:36:25.882467 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 212/411] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:36:25 2022] GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb => generated 1444 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:36:25.900195 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-aa59a765-bada-4cac-8267-53d4cc91a125 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:36:25.901443 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-aa59a765-bada-4cac-8267-53d4cc91a125 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] [instance: 17ef4273-4c60-498a-9061-2c4fbedbafdb] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:36:25.908225 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-aa59a765-bada-4cac-8267-53d4cc91a125 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:25.908941 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-aa59a765-bada-4cac-8267-53d4cc91a125 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:25.909730 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-aa59a765-bada-4cac-8267-53d4cc91a125 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:25.910166 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-aa59a765-bada-4cac-8267-53d4cc91a125 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:26.187905 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-aa59a765-bada-4cac-8267-53d4cc91a125 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81aa9d47cd1470abef31a27839eaf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8abe616c14a4920b1cbc45733fa5771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:36:26.195796 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-aa59a765-bada-4cac-8267-53d4cc91a125 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] 10.222.0.57 "GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb" status: 200 len: 1444 microversion: 2.1 time: 0.300607 Jun 30 12:36:26.196729 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 200/412] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:36:25 2022] GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb => generated 1444 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:36:26.246227 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-fa1dd34d-4a0b-406e-b32e-60a51d2040b1 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:36:26.247501 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-fa1dd34d-4a0b-406e-b32e-60a51d2040b1 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] [instance: d328d6c1-d49a-48c5-a26e-1ab70019f6df] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:36:26.253654 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-fa1dd34d-4a0b-406e-b32e-60a51d2040b1 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:26.254210 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-fa1dd34d-4a0b-406e-b32e-60a51d2040b1 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:26.255208 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-fa1dd34d-4a0b-406e-b32e-60a51d2040b1 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:26.255713 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-fa1dd34d-4a0b-406e-b32e-60a51d2040b1 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:26.595817 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-fa1dd34d-4a0b-406e-b32e-60a51d2040b1 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc65fea19f94fd18d83ad8ce3bbb476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a42d5073b0f4e4c857d794aa8d30393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:36:26.604007 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-fa1dd34d-4a0b-406e-b32e-60a51d2040b1 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] 10.222.0.57 "GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df" status: 200 len: 1752 microversion: 2.1 time: 0.362785 Jun 30 12:36:26.605242 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 213/413] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:36:26 2022] GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df => generated 1752 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:36:26.864203 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [req-93dff331-084c-42c2-b43c-0470af597da7 req-bba6f9d3-f2ef-4b28-be8a-e17b7d3858b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42333613-46ed-4609-bb89-b0e3e7358ea0", "tag": "666490d7-bc72-4807-aafd-f8b8f454ed23"}]} {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:36:26.879604 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [req-93dff331-084c-42c2-b43c-0470af597da7 req-bba6f9d3-f2ef-4b28-be8a-e17b7d3858b9 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:26.880053 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [req-93dff331-084c-42c2-b43c-0470af597da7 req-bba6f9d3-f2ef-4b28-be8a-e17b7d3858b9 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:26.899050 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.compute.server_external_events [req-93dff331-084c-42c2-b43c-0470af597da7 req-bba6f9d3-f2ef-4b28-be8a-e17b7d3858b9 service nova] Creating event network-changed:666490d7-bc72-4807-aafd-f8b8f454ed23 for instance 42333613-46ed-4609-bb89-b0e3e7358ea0 on hv-cinder-84614 Jun 30 12:36:26.905425 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [req-93dff331-084c-42c2-b43c-0470af597da7 req-bba6f9d3-f2ef-4b28-be8a-e17b7d3858b9 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050590 Jun 30 12:36:26.913143 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 201/414] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 30 12:36:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 12:36:27.625358 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-896387af-1deb-45e9-9fe4-f05c4da5adc4 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:36:27.626698 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-896387af-1deb-45e9-9fe4-f05c4da5adc4 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] [instance: d328d6c1-d49a-48c5-a26e-1ab70019f6df] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:36:27.634897 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-896387af-1deb-45e9-9fe4-f05c4da5adc4 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:27.635543 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-896387af-1deb-45e9-9fe4-f05c4da5adc4 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:27.636512 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-896387af-1deb-45e9-9fe4-f05c4da5adc4 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:27.637208 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-896387af-1deb-45e9-9fe4-f05c4da5adc4 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:27.682652 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 12:36:27.682887 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Thu Jun 30 12:36:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df (ip 10.222.0.57) !!! Jun 30 12:36:27.805901 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-896387af-1deb-45e9-9fe4-f05c4da5adc4 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc65fea19f94fd18d83ad8ce3bbb476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a42d5073b0f4e4c857d794aa8d30393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:36:27.816085 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-896387af-1deb-45e9-9fe4-f05c4da5adc4 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] 10.222.0.57 "GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df" status: 200 len: 1752 microversion: 2.1 time: 0.194679 Jun 30 12:36:27.817396 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 214/415] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:36:27 2022] GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df => generated 1752 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:36:28.406927 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [req-9e5d2b3b-1a5d-43b3-9bce-36ea15e4468c req-17c44f33-4319-4abf-9df5-07c73b7db620 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17ef4273-4c60-498a-9061-2c4fbedbafdb", "tag": "7fb1dbc5-fce3-4c9f-bb9e-b486d232eebc"}]} {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:36:28.415930 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [req-9e5d2b3b-1a5d-43b3-9bce-36ea15e4468c req-17c44f33-4319-4abf-9df5-07c73b7db620 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:28.416372 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [req-9e5d2b3b-1a5d-43b3-9bce-36ea15e4468c req-17c44f33-4319-4abf-9df5-07c73b7db620 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:28.427172 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.compute.server_external_events [req-9e5d2b3b-1a5d-43b3-9bce-36ea15e4468c req-17c44f33-4319-4abf-9df5-07c73b7db620 service nova] Creating event network-changed:7fb1dbc5-fce3-4c9f-bb9e-b486d232eebc for instance 17ef4273-4c60-498a-9061-2c4fbedbafdb on hv-cinder-84614 Jun 30 12:36:28.432148 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [req-9e5d2b3b-1a5d-43b3-9bce-36ea15e4468c req-17c44f33-4319-4abf-9df5-07c73b7db620 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029713 Jun 30 12:36:28.432678 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 202/416] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 30 12:36:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:36:28.834467 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-ff14d1a8-e0b8-4abd-bec9-1ea6ca37fae7 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:36:28.835053 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-ff14d1a8-e0b8-4abd-bec9-1ea6ca37fae7 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] [instance: d328d6c1-d49a-48c5-a26e-1ab70019f6df] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:36:28.841852 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-ff14d1a8-e0b8-4abd-bec9-1ea6ca37fae7 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:28.842299 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-ff14d1a8-e0b8-4abd-bec9-1ea6ca37fae7 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:28.843078 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-ff14d1a8-e0b8-4abd-bec9-1ea6ca37fae7 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:28.843537 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-ff14d1a8-e0b8-4abd-bec9-1ea6ca37fae7 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:28.994232 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-ff14d1a8-e0b8-4abd-bec9-1ea6ca37fae7 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc65fea19f94fd18d83ad8ce3bbb476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a42d5073b0f4e4c857d794aa8d30393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:36:29.002508 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-ff14d1a8-e0b8-4abd-bec9-1ea6ca37fae7 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] 10.222.0.57 "GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df" status: 200 len: 1752 microversion: 2.1 time: 0.172061 Jun 30 12:36:29.003279 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 215/417] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:36:28 2022] GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df => generated 1752 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:36:30.020215 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-ecf0fd9d-07fd-4ac0-8931-3a38284a405d tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:36:30.021033 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-ecf0fd9d-07fd-4ac0-8931-3a38284a405d tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] [instance: d328d6c1-d49a-48c5-a26e-1ab70019f6df] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:36:30.027974 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-ecf0fd9d-07fd-4ac0-8931-3a38284a405d tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:30.028431 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-ecf0fd9d-07fd-4ac0-8931-3a38284a405d tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:30.029230 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-ecf0fd9d-07fd-4ac0-8931-3a38284a405d tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:30.029661 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-ecf0fd9d-07fd-4ac0-8931-3a38284a405d tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:30.192553 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-ecf0fd9d-07fd-4ac0-8931-3a38284a405d tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc65fea19f94fd18d83ad8ce3bbb476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a42d5073b0f4e4c857d794aa8d30393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:36:30.202186 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-ecf0fd9d-07fd-4ac0-8931-3a38284a405d tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] 10.222.0.57 "GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df" status: 200 len: 1757 microversion: 2.1 time: 0.186552 Jun 30 12:36:30.204948 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 203/418] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:36:30 2022] GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df => generated 1757 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:36:31.220331 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-0d362ec4-b5bd-4b95-b09f-970ad5fad15d tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:36:31.221109 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-0d362ec4-b5bd-4b95-b09f-970ad5fad15d tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] [instance: d328d6c1-d49a-48c5-a26e-1ab70019f6df] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:36:31.228589 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-0d362ec4-b5bd-4b95-b09f-970ad5fad15d tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:31.229067 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-0d362ec4-b5bd-4b95-b09f-970ad5fad15d tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:31.229843 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-0d362ec4-b5bd-4b95-b09f-970ad5fad15d tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:31.230266 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-0d362ec4-b5bd-4b95-b09f-970ad5fad15d tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:31.383728 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-0d362ec4-b5bd-4b95-b09f-970ad5fad15d tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc65fea19f94fd18d83ad8ce3bbb476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a42d5073b0f4e4c857d794aa8d30393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:36:31.392448 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-0d362ec4-b5bd-4b95-b09f-970ad5fad15d tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] 10.222.0.57 "GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df" status: 200 len: 1757 microversion: 2.1 time: 0.175984 Jun 30 12:36:31.393054 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 216/419] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:36:31 2022] GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df => generated 1757 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:36:32.412398 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-960a0da0-1181-43a1-aeb9-8d4ae0ba09d7 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:36:32.413065 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-960a0da0-1181-43a1-aeb9-8d4ae0ba09d7 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] [instance: d328d6c1-d49a-48c5-a26e-1ab70019f6df] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:36:32.420438 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-960a0da0-1181-43a1-aeb9-8d4ae0ba09d7 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:32.420928 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-960a0da0-1181-43a1-aeb9-8d4ae0ba09d7 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:32.421696 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-960a0da0-1181-43a1-aeb9-8d4ae0ba09d7 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:32.422138 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-960a0da0-1181-43a1-aeb9-8d4ae0ba09d7 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:32.571654 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-960a0da0-1181-43a1-aeb9-8d4ae0ba09d7 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc65fea19f94fd18d83ad8ce3bbb476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a42d5073b0f4e4c857d794aa8d30393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:36:32.580157 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-960a0da0-1181-43a1-aeb9-8d4ae0ba09d7 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] 10.222.0.57 "GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df" status: 200 len: 1757 microversion: 2.1 time: 0.171665 Jun 30 12:36:32.580746 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 204/420] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:36:32 2022] GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:36:33.597954 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-67d37efc-1e5b-4883-9bc9-007f48474b2e tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:36:33.598577 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-67d37efc-1e5b-4883-9bc9-007f48474b2e tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] [instance: d328d6c1-d49a-48c5-a26e-1ab70019f6df] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:36:33.605432 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-67d37efc-1e5b-4883-9bc9-007f48474b2e tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:33.605889 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-67d37efc-1e5b-4883-9bc9-007f48474b2e tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:33.606655 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-67d37efc-1e5b-4883-9bc9-007f48474b2e tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:33.607082 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-67d37efc-1e5b-4883-9bc9-007f48474b2e tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:33.759627 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-67d37efc-1e5b-4883-9bc9-007f48474b2e tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc65fea19f94fd18d83ad8ce3bbb476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a42d5073b0f4e4c857d794aa8d30393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:36:33.767933 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-67d37efc-1e5b-4883-9bc9-007f48474b2e tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] 10.222.0.57 "GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df" status: 200 len: 1757 microversion: 2.1 time: 0.173915 Jun 30 12:36:33.768726 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 217/421] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:36:33 2022] GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df => generated 1757 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:36:34.787043 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-6d02f3a6-61a5-4609-9c0f-d51ac7fcc405 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:36:34.787664 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-6d02f3a6-61a5-4609-9c0f-d51ac7fcc405 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] [instance: d328d6c1-d49a-48c5-a26e-1ab70019f6df] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:36:34.790508 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG dbcounter [-] [124298] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=6 {{(pid=124298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:36:34.796745 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-6d02f3a6-61a5-4609-9c0f-d51ac7fcc405 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:34.797189 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-6d02f3a6-61a5-4609-9c0f-d51ac7fcc405 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:34.797954 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-6d02f3a6-61a5-4609-9c0f-d51ac7fcc405 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:34.798388 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-6d02f3a6-61a5-4609-9c0f-d51ac7fcc405 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:34.955704 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-6d02f3a6-61a5-4609-9c0f-d51ac7fcc405 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc65fea19f94fd18d83ad8ce3bbb476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a42d5073b0f4e4c857d794aa8d30393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:36:34.964223 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-6d02f3a6-61a5-4609-9c0f-d51ac7fcc405 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] 10.222.0.57 "GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df" status: 200 len: 1757 microversion: 2.1 time: 0.181204 Jun 30 12:36:34.964919 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 205/422] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:36:34 2022] GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df => generated 1757 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:36:35.981875 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-a3ca340c-8ec3-43aa-88ab-5cb02399ad37 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:36:35.982528 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-a3ca340c-8ec3-43aa-88ab-5cb02399ad37 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] [instance: d328d6c1-d49a-48c5-a26e-1ab70019f6df] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:36:35.985483 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG dbcounter [-] [124297] Writing DB stats nova_api:SELECT=61 {{(pid=124297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:36:35.990733 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-a3ca340c-8ec3-43aa-88ab-5cb02399ad37 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:35.991186 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-a3ca340c-8ec3-43aa-88ab-5cb02399ad37 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:35.991961 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-a3ca340c-8ec3-43aa-88ab-5cb02399ad37 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:35.992397 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-a3ca340c-8ec3-43aa-88ab-5cb02399ad37 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:36.139956 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-a3ca340c-8ec3-43aa-88ab-5cb02399ad37 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc65fea19f94fd18d83ad8ce3bbb476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a42d5073b0f4e4c857d794aa8d30393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:36:36.148044 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-a3ca340c-8ec3-43aa-88ab-5cb02399ad37 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] 10.222.0.57 "GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df" status: 200 len: 1757 microversion: 2.1 time: 0.171244 Jun 30 12:36:36.148601 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 218/423] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:36:35 2022] GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:36:37.166537 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-a2d63316-42e1-4984-b2b5-c7ed898844f2 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:36:37.167774 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-a2d63316-42e1-4984-b2b5-c7ed898844f2 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] [instance: d328d6c1-d49a-48c5-a26e-1ab70019f6df] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:36:37.174894 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-a2d63316-42e1-4984-b2b5-c7ed898844f2 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:37.175422 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-a2d63316-42e1-4984-b2b5-c7ed898844f2 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:37.176245 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-a2d63316-42e1-4984-b2b5-c7ed898844f2 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:37.176959 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-a2d63316-42e1-4984-b2b5-c7ed898844f2 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:37.342335 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-a2d63316-42e1-4984-b2b5-c7ed898844f2 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc65fea19f94fd18d83ad8ce3bbb476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a42d5073b0f4e4c857d794aa8d30393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:36:37.350388 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-a2d63316-42e1-4984-b2b5-c7ed898844f2 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] 10.222.0.57 "GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df" status: 200 len: 1757 microversion: 2.1 time: 0.188095 Jun 30 12:36:37.350962 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 206/424] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:36:37 2022] GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df => generated 1757 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:36:38.367834 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-9c29254d-d696-467e-bb6b-4ee7205ac6c3 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:36:38.368491 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-9c29254d-d696-467e-bb6b-4ee7205ac6c3 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] [instance: d328d6c1-d49a-48c5-a26e-1ab70019f6df] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:36:38.375393 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-9c29254d-d696-467e-bb6b-4ee7205ac6c3 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:38.375845 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-9c29254d-d696-467e-bb6b-4ee7205ac6c3 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:38.376617 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-9c29254d-d696-467e-bb6b-4ee7205ac6c3 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:38.377077 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-9c29254d-d696-467e-bb6b-4ee7205ac6c3 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:38.534049 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-9c29254d-d696-467e-bb6b-4ee7205ac6c3 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc65fea19f94fd18d83ad8ce3bbb476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a42d5073b0f4e4c857d794aa8d30393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:36:38.543605 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-9c29254d-d696-467e-bb6b-4ee7205ac6c3 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] 10.222.0.57 "GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df" status: 200 len: 1757 microversion: 2.1 time: 0.179519 Jun 30 12:36:38.543953 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 219/425] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:36:38 2022] GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df => generated 1757 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:36:39.563451 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-91e5303a-5554-4fc5-baec-b6afcc65cf40 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:36:39.564049 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-91e5303a-5554-4fc5-baec-b6afcc65cf40 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] [instance: d328d6c1-d49a-48c5-a26e-1ab70019f6df] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:36:39.570725 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-91e5303a-5554-4fc5-baec-b6afcc65cf40 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:39.571150 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-91e5303a-5554-4fc5-baec-b6afcc65cf40 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:39.571950 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-91e5303a-5554-4fc5-baec-b6afcc65cf40 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:39.572387 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-91e5303a-5554-4fc5-baec-b6afcc65cf40 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:39.729145 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-91e5303a-5554-4fc5-baec-b6afcc65cf40 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc65fea19f94fd18d83ad8ce3bbb476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a42d5073b0f4e4c857d794aa8d30393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:36:39.737703 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-91e5303a-5554-4fc5-baec-b6afcc65cf40 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] 10.222.0.57 "GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df" status: 200 len: 1757 microversion: 2.1 time: 0.178997 Jun 30 12:36:39.738286 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 207/426] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:36:39 2022] GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df => generated 1757 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:36:40.361705 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-caebec90-9e9e-4abe-a2f4-b75c2e0568ec tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:36:40.362489 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-caebec90-9e9e-4abe-a2f4-b75c2e0568ec tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 99ba3b96-6700-41e0-b2cf-ff8933b2bf94] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:36:40.373010 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-caebec90-9e9e-4abe-a2f4-b75c2e0568ec tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:40.373459 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-caebec90-9e9e-4abe-a2f4-b75c2e0568ec tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:40.374229 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-caebec90-9e9e-4abe-a2f4-b75c2e0568ec tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:40.374662 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-caebec90-9e9e-4abe-a2f4-b75c2e0568ec tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:40.506746 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.objects.instance [None req-caebec90-9e9e-4abe-a2f4-b75c2e0568ec tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lazy-loading 'services' on Instance uuid 99ba3b96-6700-41e0-b2cf-ff8933b2bf94 {{(pid=124297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 12:36:40.562340 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-65a927ef-5ad6-442c-8ec7-8a61dafed7fa tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1925925576", "imageRef": "776a1662-a241-4e20-9a9c-e4743c64efd0", "flavorRef": "452", "networks": [{"uuid": "8db768bb-11e9-4127-8aac-ea023e37020c"}]}} {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:36:40.616314 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.network.neutron [None req-65a927ef-5ad6-442c-8ec7-8a61dafed7fa tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] validate_networks() for [('8db768bb-11e9-4127-8aac-ea023e37020c', None, None, None, None, None)] {{(pid=124298) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 12:36:40.629889 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-caebec90-9e9e-4abe-a2f4-b75c2e0568ec tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "DELETE /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94/os-volume_attachments/70be5a72-4440-4a1a-bbcc-cd138178ae42" status: 202 len: 0 microversion: 2.1 time: 0.275024 Jun 30 12:36:40.630466 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 220/427] 10.222.0.57 () {58 vars in 1415 bytes} [Thu Jun 30 12:36:40 2022] DELETE /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94/os-volume_attachments/70be5a72-4440-4a1a-bbcc-cd138178ae42 => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 12:36:40.756080 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-a2e6a369-4cd2-4cf1-baa1-cf520779f0cc tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:36:40.756836 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-a2e6a369-4cd2-4cf1-baa1-cf520779f0cc tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] [instance: d328d6c1-d49a-48c5-a26e-1ab70019f6df] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:36:40.763122 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-a2e6a369-4cd2-4cf1-baa1-cf520779f0cc tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:40.763585 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-a2e6a369-4cd2-4cf1-baa1-cf520779f0cc tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:40.764415 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-a2e6a369-4cd2-4cf1-baa1-cf520779f0cc tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:40.764884 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-a2e6a369-4cd2-4cf1-baa1-cf520779f0cc tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:40.994453 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-a2e6a369-4cd2-4cf1-baa1-cf520779f0cc tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc65fea19f94fd18d83ad8ce3bbb476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a42d5073b0f4e4c857d794aa8d30393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:36:41.003306 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-a2e6a369-4cd2-4cf1-baa1-cf520779f0cc tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] 10.222.0.57 "GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df" status: 200 len: 1757 microversion: 2.1 time: 0.251359 Jun 30 12:36:41.003861 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 221/428] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:36:40 2022] GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df => generated 1757 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:36:41.068809 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.virt.hardware [None req-65a927ef-5ad6-442c-8ec7-8a61dafed7fa tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Flavor limits 0:0:0 {{(pid=124298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 12:36:41.069253 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.virt.hardware [None req-65a927ef-5ad6-442c-8ec7-8a61dafed7fa tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Image limits 0:0:0 {{(pid=124298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 12:36:41.069706 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.virt.hardware [None req-65a927ef-5ad6-442c-8ec7-8a61dafed7fa tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Flavor pref 0:0:0 {{(pid=124298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 12:36:41.070111 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.virt.hardware [None req-65a927ef-5ad6-442c-8ec7-8a61dafed7fa tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Image pref 0:0:0 {{(pid=124298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 12:36:41.070519 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.virt.hardware [None req-65a927ef-5ad6-442c-8ec7-8a61dafed7fa tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 12:36:41.079951 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-65a927ef-5ad6-442c-8ec7-8a61dafed7fa tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:41.080406 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-65a927ef-5ad6-442c-8ec7-8a61dafed7fa tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:41.081224 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-65a927ef-5ad6-442c-8ec7-8a61dafed7fa tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:41.081653 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-65a927ef-5ad6-442c-8ec7-8a61dafed7fa tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:41.098120 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.quota [None req-65a927ef-5ad6-442c-8ec7-8a61dafed7fa tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Getting quotas for project e3eabfe3692b44d8ae5f7d137ce1d157. Resources: {'cores', 'ram', 'instances'} {{(pid=124298) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 12:36:41.102193 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.quota [None req-65a927ef-5ad6-442c-8ec7-8a61dafed7fa tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Getting quotas for user 4bdc0eeb6cd443d78aefefca488d8c5d and project e3eabfe3692b44d8ae5f7d137ce1d157. Resources: {'cores', 'ram', 'instances'} {{(pid=124298) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 12:36:41.113427 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-65a927ef-5ad6-442c-8ec7-8a61dafed7fa tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Going to run 1 instances... {{(pid=124298) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 12:36:41.115835 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-65a927ef-5ad6-442c-8ec7-8a61dafed7fa tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] [instance: cac81943-11c4-47b1-8bbc-c34b261f8237] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='776a1662-a241-4e20-9a9c-e4743c64efd0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124298) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 12:36:41.163925 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-65a927ef-5ad6-442c-8ec7-8a61dafed7fa tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.605569 Jun 30 12:36:41.170811 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 208/429] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 30 12:36:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 613 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 30 12:36:41.176219 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-db52d094-e667-4db2-9331-f55ed2f2d5e9 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:36:41.177013 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-db52d094-e667-4db2-9331-f55ed2f2d5e9 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] [instance: cac81943-11c4-47b1-8bbc-c34b261f8237] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:36:41.237580 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-db52d094-e667-4db2-9331-f55ed2f2d5e9 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdc0eeb6cd443d78aefefca488d8c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3eabfe3692b44d8ae5f7d137ce1d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:36:41.244440 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-db52d094-e667-4db2-9331-f55ed2f2d5e9 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] 10.222.0.57 "GET /compute/v2.1/servers/cac81943-11c4-47b1-8bbc-c34b261f8237" status: 200 len: 1219 microversion: 2.1 time: 0.072580 Jun 30 12:36:41.245060 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 222/430] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:36:41 2022] GET /compute/v2.1/servers/cac81943-11c4-47b1-8bbc-c34b261f8237 => generated 1219 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 12:36:42.024988 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-a852bb13-7a2a-49fa-9124-530106115722 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:36:42.025851 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-a852bb13-7a2a-49fa-9124-530106115722 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] [instance: d328d6c1-d49a-48c5-a26e-1ab70019f6df] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:36:42.033981 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-a852bb13-7a2a-49fa-9124-530106115722 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:42.034431 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-a852bb13-7a2a-49fa-9124-530106115722 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:42.035201 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-a852bb13-7a2a-49fa-9124-530106115722 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:42.035637 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-a852bb13-7a2a-49fa-9124-530106115722 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:42.186864 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-a852bb13-7a2a-49fa-9124-530106115722 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc65fea19f94fd18d83ad8ce3bbb476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a42d5073b0f4e4c857d794aa8d30393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:36:42.199241 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-a852bb13-7a2a-49fa-9124-530106115722 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] 10.222.0.57 "GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df" status: 200 len: 1757 microversion: 2.1 time: 0.181484 Jun 30 12:36:42.200037 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 209/431] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:36:42 2022] GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df => generated 1757 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:36:42.263170 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-64748711-7f5e-4886-a564-79610ff91d11 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:36:42.263823 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-64748711-7f5e-4886-a564-79610ff91d11 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] [instance: cac81943-11c4-47b1-8bbc-c34b261f8237] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:36:42.271311 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-64748711-7f5e-4886-a564-79610ff91d11 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:42.271748 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-64748711-7f5e-4886-a564-79610ff91d11 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:42.272501 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-64748711-7f5e-4886-a564-79610ff91d11 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:42.272960 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-64748711-7f5e-4886-a564-79610ff91d11 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:42.336117 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-64748711-7f5e-4886-a564-79610ff91d11 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdc0eeb6cd443d78aefefca488d8c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3eabfe3692b44d8ae5f7d137ce1d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:36:42.347203 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-64748711-7f5e-4886-a564-79610ff91d11 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] 10.222.0.57 "GET /compute/v2.1/servers/cac81943-11c4-47b1-8bbc-c34b261f8237" status: 200 len: 1223 microversion: 2.1 time: 0.087966 Jun 30 12:36:42.347904 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 223/432] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:36:42 2022] GET /compute/v2.1/servers/cac81943-11c4-47b1-8bbc-c34b261f8237 => generated 1223 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:36:43.217728 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-44e2ed83-3314-436a-b68d-7a074c247dcc tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:36:43.218300 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-44e2ed83-3314-436a-b68d-7a074c247dcc tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] [instance: d328d6c1-d49a-48c5-a26e-1ab70019f6df] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:36:43.225187 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-44e2ed83-3314-436a-b68d-7a074c247dcc tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:43.225633 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-44e2ed83-3314-436a-b68d-7a074c247dcc tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:43.226401 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-44e2ed83-3314-436a-b68d-7a074c247dcc tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:43.226834 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-44e2ed83-3314-436a-b68d-7a074c247dcc tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:43.367450 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-fdc3ca58-ee5d-47e4-989c-1e4b55907c45 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:36:43.368061 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-fdc3ca58-ee5d-47e4-989c-1e4b55907c45 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] [instance: cac81943-11c4-47b1-8bbc-c34b261f8237] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:36:43.374828 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-44e2ed83-3314-436a-b68d-7a074c247dcc tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc65fea19f94fd18d83ad8ce3bbb476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a42d5073b0f4e4c857d794aa8d30393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:36:43.375848 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-fdc3ca58-ee5d-47e4-989c-1e4b55907c45 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:43.376283 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-fdc3ca58-ee5d-47e4-989c-1e4b55907c45 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:43.377074 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-fdc3ca58-ee5d-47e4-989c-1e4b55907c45 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:43.377502 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-fdc3ca58-ee5d-47e4-989c-1e4b55907c45 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:43.382915 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-44e2ed83-3314-436a-b68d-7a074c247dcc tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] 10.222.0.57 "GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df" status: 200 len: 1757 microversion: 2.1 time: 0.169553 Jun 30 12:36:43.383483 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 210/433] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:36:43 2022] GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:36:43.441164 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-fdc3ca58-ee5d-47e4-989c-1e4b55907c45 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdc0eeb6cd443d78aefefca488d8c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3eabfe3692b44d8ae5f7d137ce1d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:36:43.451052 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-fdc3ca58-ee5d-47e4-989c-1e4b55907c45 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] 10.222.0.57 "GET /compute/v2.1/servers/cac81943-11c4-47b1-8bbc-c34b261f8237" status: 200 len: 1223 microversion: 2.1 time: 0.087250 Jun 30 12:36:43.451787 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 224/434] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:36:43 2022] GET /compute/v2.1/servers/cac81943-11c4-47b1-8bbc-c34b261f8237 => generated 1223 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:36:44.406253 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-0e29f2c5-6366-4d4c-bd92-4978153f26c8 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:36:44.407316 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-0e29f2c5-6366-4d4c-bd92-4978153f26c8 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] [instance: d328d6c1-d49a-48c5-a26e-1ab70019f6df] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:36:44.418568 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-0e29f2c5-6366-4d4c-bd92-4978153f26c8 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:44.419315 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-0e29f2c5-6366-4d4c-bd92-4978153f26c8 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:44.420753 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-0e29f2c5-6366-4d4c-bd92-4978153f26c8 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:44.421321 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-0e29f2c5-6366-4d4c-bd92-4978153f26c8 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:44.471537 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-2c267f35-770e-44d8-b59a-127cbdb22358 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:36:44.472260 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-2c267f35-770e-44d8-b59a-127cbdb22358 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] [instance: cac81943-11c4-47b1-8bbc-c34b261f8237] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:36:44.479232 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-2c267f35-770e-44d8-b59a-127cbdb22358 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:44.479756 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-2c267f35-770e-44d8-b59a-127cbdb22358 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:44.480577 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-2c267f35-770e-44d8-b59a-127cbdb22358 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:44.481069 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-2c267f35-770e-44d8-b59a-127cbdb22358 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:44.557584 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-2c267f35-770e-44d8-b59a-127cbdb22358 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdc0eeb6cd443d78aefefca488d8c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3eabfe3692b44d8ae5f7d137ce1d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:36:44.566376 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-2c267f35-770e-44d8-b59a-127cbdb22358 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] 10.222.0.57 "GET /compute/v2.1/servers/cac81943-11c4-47b1-8bbc-c34b261f8237" status: 200 len: 1223 microversion: 2.1 time: 0.098601 Jun 30 12:36:44.566919 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 225/435] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:36:44 2022] GET /compute/v2.1/servers/cac81943-11c4-47b1-8bbc-c34b261f8237 => generated 1223 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:36:44.594001 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-0e29f2c5-6366-4d4c-bd92-4978153f26c8 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc65fea19f94fd18d83ad8ce3bbb476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a42d5073b0f4e4c857d794aa8d30393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:36:44.605501 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-0e29f2c5-6366-4d4c-bd92-4978153f26c8 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] 10.222.0.57 "GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df" status: 200 len: 1757 microversion: 2.1 time: 0.207021 Jun 30 12:36:44.606312 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 211/436] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:36:44 2022] GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df => generated 1757 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:36:45.337320 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-1bcab6df-84de-4dd7-8810-69bc222383b7 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "944feb9e-e424-4f80-979c-b821a2c9bde6"}} {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:36:45.339214 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-1bcab6df-84de-4dd7-8810-69bc222383b7 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: 7f35d48f-59b1-4105-a9ea-a6ffee1b86d0] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:36:45.349823 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-1bcab6df-84de-4dd7-8810-69bc222383b7 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:45.350559 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-1bcab6df-84de-4dd7-8810-69bc222383b7 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:45.351828 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-1bcab6df-84de-4dd7-8810-69bc222383b7 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:45.352545 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-1bcab6df-84de-4dd7-8810-69bc222383b7 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:45.372836 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG dbcounter [-] [124297] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=124297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:36:45.587032 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-ef3f43bf-7969-413c-969b-61dd60f932f5 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:36:45.587999 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-ef3f43bf-7969-413c-969b-61dd60f932f5 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] [instance: cac81943-11c4-47b1-8bbc-c34b261f8237] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:36:45.596562 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-ef3f43bf-7969-413c-969b-61dd60f932f5 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:45.597046 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-ef3f43bf-7969-413c-969b-61dd60f932f5 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:45.597812 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-ef3f43bf-7969-413c-969b-61dd60f932f5 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:45.598250 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-ef3f43bf-7969-413c-969b-61dd60f932f5 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:45.667895 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-ef3f43bf-7969-413c-969b-61dd60f932f5 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdc0eeb6cd443d78aefefca488d8c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3eabfe3692b44d8ae5f7d137ce1d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:36:45.675904 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-ef3f43bf-7969-413c-969b-61dd60f932f5 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] 10.222.0.57 "GET /compute/v2.1/servers/cac81943-11c4-47b1-8bbc-c34b261f8237" status: 200 len: 1223 microversion: 2.1 time: 0.095592 Jun 30 12:36:45.676472 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 212/437] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:36:45 2022] GET /compute/v2.1/servers/cac81943-11c4-47b1-8bbc-c34b261f8237 => generated 1223 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:36:45.680879 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-5adbfe18-9977-4445-9318-26aab88bb560 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:36:45.681480 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-5adbfe18-9977-4445-9318-26aab88bb560 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] [instance: d328d6c1-d49a-48c5-a26e-1ab70019f6df] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:36:45.687245 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-5adbfe18-9977-4445-9318-26aab88bb560 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:45.687719 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-5adbfe18-9977-4445-9318-26aab88bb560 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:45.688487 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-5adbfe18-9977-4445-9318-26aab88bb560 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:45.688954 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-5adbfe18-9977-4445-9318-26aab88bb560 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:45.840676 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-5adbfe18-9977-4445-9318-26aab88bb560 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc65fea19f94fd18d83ad8ce3bbb476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a42d5073b0f4e4c857d794aa8d30393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:36:45.849713 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-5adbfe18-9977-4445-9318-26aab88bb560 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] 10.222.0.57 "GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df" status: 200 len: 1757 microversion: 2.1 time: 0.172268 Jun 30 12:36:45.850277 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 213/438] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:36:45 2022] GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:36:46.693471 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-e13f9da9-4310-476a-8753-8a5b55d92947 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:36:46.694052 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-e13f9da9-4310-476a-8753-8a5b55d92947 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] [instance: cac81943-11c4-47b1-8bbc-c34b261f8237] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:36:46.700760 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-e13f9da9-4310-476a-8753-8a5b55d92947 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:46.701211 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-e13f9da9-4310-476a-8753-8a5b55d92947 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:46.702036 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-e13f9da9-4310-476a-8753-8a5b55d92947 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:46.702469 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-e13f9da9-4310-476a-8753-8a5b55d92947 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:46.785195 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-e13f9da9-4310-476a-8753-8a5b55d92947 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdc0eeb6cd443d78aefefca488d8c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3eabfe3692b44d8ae5f7d137ce1d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:36:46.793968 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-e13f9da9-4310-476a-8753-8a5b55d92947 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] 10.222.0.57 "GET /compute/v2.1/servers/cac81943-11c4-47b1-8bbc-c34b261f8237" status: 200 len: 1215 microversion: 2.1 time: 0.104367 Jun 30 12:36:46.794680 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 214/439] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:36:46 2022] GET /compute/v2.1/servers/cac81943-11c4-47b1-8bbc-c34b261f8237 => generated 1215 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 12:36:46.803472 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-1bcab6df-84de-4dd7-8810-69bc222383b7 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "POST /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.472976 Jun 30 12:36:46.804135 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 226/440] 10.222.0.57 () {60 vars in 1322 bytes} [Thu Jun 30 12:36:45 2022] POST /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0/os-volume_attachments => generated 194 bytes in 1475 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:36:46.875545 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-4c175822-f852-4a68-bc2b-96cdd01e799a tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:36:46.876414 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-4c175822-f852-4a68-bc2b-96cdd01e799a tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] [instance: d328d6c1-d49a-48c5-a26e-1ab70019f6df] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:36:46.885362 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-4c175822-f852-4a68-bc2b-96cdd01e799a tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:46.886001 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-4c175822-f852-4a68-bc2b-96cdd01e799a tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:46.887086 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-4c175822-f852-4a68-bc2b-96cdd01e799a tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:46.887643 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-4c175822-f852-4a68-bc2b-96cdd01e799a tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:46.893448 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG dbcounter [-] [124298] Writing DB stats nova_cell1:SELECT=100 {{(pid=124298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:36:47.033557 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-4c175822-f852-4a68-bc2b-96cdd01e799a tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc65fea19f94fd18d83ad8ce3bbb476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a42d5073b0f4e4c857d794aa8d30393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:36:47.042071 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-4c175822-f852-4a68-bc2b-96cdd01e799a tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] 10.222.0.57 "GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df" status: 200 len: 1757 microversion: 2.1 time: 0.172028 Jun 30 12:36:47.042606 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 215/441] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:36:46 2022] GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df => generated 1757 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:36:47.814381 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-01654f10-2c47-421b-8c9d-645d689113a3 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:36:47.815042 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-01654f10-2c47-421b-8c9d-645d689113a3 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] [instance: cac81943-11c4-47b1-8bbc-c34b261f8237] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:36:47.821856 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-01654f10-2c47-421b-8c9d-645d689113a3 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:47.822301 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-01654f10-2c47-421b-8c9d-645d689113a3 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:47.823067 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-01654f10-2c47-421b-8c9d-645d689113a3 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:47.823495 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-01654f10-2c47-421b-8c9d-645d689113a3 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:47.889012 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-01654f10-2c47-421b-8c9d-645d689113a3 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdc0eeb6cd443d78aefefca488d8c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3eabfe3692b44d8ae5f7d137ce1d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:36:47.898510 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-01654f10-2c47-421b-8c9d-645d689113a3 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] 10.222.0.57 "GET /compute/v2.1/servers/cac81943-11c4-47b1-8bbc-c34b261f8237" status: 200 len: 1271 microversion: 2.1 time: 0.089796 Jun 30 12:36:47.899068 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 227/442] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:36:47 2022] GET /compute/v2.1/servers/cac81943-11c4-47b1-8bbc-c34b261f8237 => generated 1271 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:36:48.059450 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-4c14ca56-8004-4930-8867-9bc1ad1334df tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:36:48.060062 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-4c14ca56-8004-4930-8867-9bc1ad1334df tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] [instance: d328d6c1-d49a-48c5-a26e-1ab70019f6df] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:36:48.067322 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-4c14ca56-8004-4930-8867-9bc1ad1334df tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:48.067733 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-4c14ca56-8004-4930-8867-9bc1ad1334df tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:48.068544 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-4c14ca56-8004-4930-8867-9bc1ad1334df tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:48.069058 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-4c14ca56-8004-4930-8867-9bc1ad1334df tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:48.233187 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-4c14ca56-8004-4930-8867-9bc1ad1334df tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc65fea19f94fd18d83ad8ce3bbb476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a42d5073b0f4e4c857d794aa8d30393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:36:48.241935 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-4c14ca56-8004-4930-8867-9bc1ad1334df tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] 10.222.0.57 "GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df" status: 200 len: 1760 microversion: 2.1 time: 0.186237 Jun 30 12:36:48.242510 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 216/443] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:36:48 2022] GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df => generated 1760 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:36:48.915930 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-3d28e969-5dfb-4989-a798-d5f8e770c6ec tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:36:48.916520 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-3d28e969-5dfb-4989-a798-d5f8e770c6ec tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] [instance: cac81943-11c4-47b1-8bbc-c34b261f8237] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:36:48.925112 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-3d28e969-5dfb-4989-a798-d5f8e770c6ec tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:48.925472 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-3d28e969-5dfb-4989-a798-d5f8e770c6ec tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:48.926603 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-3d28e969-5dfb-4989-a798-d5f8e770c6ec tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:48.927212 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-3d28e969-5dfb-4989-a798-d5f8e770c6ec tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:49.068005 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-3d28e969-5dfb-4989-a798-d5f8e770c6ec tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdc0eeb6cd443d78aefefca488d8c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3eabfe3692b44d8ae5f7d137ce1d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:36:49.078535 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-3d28e969-5dfb-4989-a798-d5f8e770c6ec tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] 10.222.0.57 "GET /compute/v2.1/servers/cac81943-11c4-47b1-8bbc-c34b261f8237" status: 200 len: 1319 microversion: 2.1 time: 0.166857 Jun 30 12:36:49.087930 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 228/444] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:36:48 2022] GET /compute/v2.1/servers/cac81943-11c4-47b1-8bbc-c34b261f8237 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:36:49.169773 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-f721f6a2-0489-48d6-8395-c903db3114cb tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:36:49.180254 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-f721f6a2-0489-48d6-8395-c903db3114cb tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:49.181168 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-f721f6a2-0489-48d6-8395-c903db3114cb tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:49.204735 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-f721f6a2-0489-48d6-8395-c903db3114cb tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 99ba3b96-6700-41e0-b2cf-ff8933b2bf94] Going to try to stop instance {{(pid=124298) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 30 12:36:49.250614 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-f721f6a2-0489-48d6-8395-c903db3114cb tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "POST /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94/action" status: 202 len: 0 microversion: 2.1 time: 0.084707 Jun 30 12:36:49.251475 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 217/445] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Jun 30 12:36:49 2022] POST /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 12:36:49.259525 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-abd302cb-43ca-49b0-a6ea-41abb95de3ab tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:36:49.260135 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-abd302cb-43ca-49b0-a6ea-41abb95de3ab tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 99ba3b96-6700-41e0-b2cf-ff8933b2bf94] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:36:49.266896 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-abd302cb-43ca-49b0-a6ea-41abb95de3ab tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:49.267376 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-abd302cb-43ca-49b0-a6ea-41abb95de3ab tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:49.268150 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-abd302cb-43ca-49b0-a6ea-41abb95de3ab tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:49.268581 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-abd302cb-43ca-49b0-a6ea-41abb95de3ab tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:49.401944 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-abd302cb-43ca-49b0-a6ea-41abb95de3ab tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddb38b4d6864a6c96b84c9a4092eea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60d10dba1d947cc97149a063a810129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:36:49.410271 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-abd302cb-43ca-49b0-a6ea-41abb95de3ab tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94" status: 200 len: 1676 microversion: 2.1 time: 0.154512 Jun 30 12:36:49.410854 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 229/446] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:36:49 2022] GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94 => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 12:36:49.526772 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [req-497194f3-acfe-49e3-b95c-979057b7782e req-2b8dbeb1-a6b8-4e15-9029-7e292d3f6832 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cac81943-11c4-47b1-8bbc-c34b261f8237", "tag": "e06fcd1b-c6e5-430f-aec7-1c5386fcf5e5"}]} {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:36:49.535598 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [req-497194f3-acfe-49e3-b95c-979057b7782e req-2b8dbeb1-a6b8-4e15-9029-7e292d3f6832 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:49.536105 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [req-497194f3-acfe-49e3-b95c-979057b7782e req-2b8dbeb1-a6b8-4e15-9029-7e292d3f6832 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:49.548958 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.compute.server_external_events [req-497194f3-acfe-49e3-b95c-979057b7782e req-2b8dbeb1-a6b8-4e15-9029-7e292d3f6832 service nova] Creating event network-changed:e06fcd1b-c6e5-430f-aec7-1c5386fcf5e5 for instance cac81943-11c4-47b1-8bbc-c34b261f8237 on hv-cinder-84614 Jun 30 12:36:49.553766 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [req-497194f3-acfe-49e3-b95c-979057b7782e req-2b8dbeb1-a6b8-4e15-9029-7e292d3f6832 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030982 Jun 30 12:36:49.554401 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 218/447] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 30 12:36:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:36:50.095396 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-896f2c88-4c81-46e5-8260-4ecf52b8649c tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:36:50.096180 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-896f2c88-4c81-46e5-8260-4ecf52b8649c tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] [instance: cac81943-11c4-47b1-8bbc-c34b261f8237] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:36:50.102974 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-896f2c88-4c81-46e5-8260-4ecf52b8649c tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:50.103417 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-896f2c88-4c81-46e5-8260-4ecf52b8649c tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:50.104176 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-896f2c88-4c81-46e5-8260-4ecf52b8649c tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:50.104607 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-896f2c88-4c81-46e5-8260-4ecf52b8649c tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:50.238106 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-896f2c88-4c81-46e5-8260-4ecf52b8649c tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdc0eeb6cd443d78aefefca488d8c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3eabfe3692b44d8ae5f7d137ce1d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:36:50.245938 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-896f2c88-4c81-46e5-8260-4ecf52b8649c tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] 10.222.0.57 "GET /compute/v2.1/servers/cac81943-11c4-47b1-8bbc-c34b261f8237" status: 200 len: 1319 microversion: 2.1 time: 0.154419 Jun 30 12:36:50.246510 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 230/448] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:36:50 2022] GET /compute/v2.1/servers/cac81943-11c4-47b1-8bbc-c34b261f8237 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:36:50.432144 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-79169e44-aaa1-4fcc-873e-b4a3ee52b8b9 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:36:50.433191 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-79169e44-aaa1-4fcc-873e-b4a3ee52b8b9 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 99ba3b96-6700-41e0-b2cf-ff8933b2bf94] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:36:50.443233 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-79169e44-aaa1-4fcc-873e-b4a3ee52b8b9 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:50.443943 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-79169e44-aaa1-4fcc-873e-b4a3ee52b8b9 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:50.445260 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-79169e44-aaa1-4fcc-873e-b4a3ee52b8b9 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:50.445971 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-79169e44-aaa1-4fcc-873e-b4a3ee52b8b9 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:50.592269 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-79169e44-aaa1-4fcc-873e-b4a3ee52b8b9 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddb38b4d6864a6c96b84c9a4092eea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60d10dba1d947cc97149a063a810129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:36:50.604137 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-79169e44-aaa1-4fcc-873e-b4a3ee52b8b9 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94" status: 200 len: 1676 microversion: 2.1 time: 0.178565 Jun 30 12:36:50.604950 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 219/449] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:36:50 2022] GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94 => generated 1676 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:36:51.266777 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-1cb9b53d-7d0e-4baa-a32a-e69c6ae44914 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:36:51.267524 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-1cb9b53d-7d0e-4baa-a32a-e69c6ae44914 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] [instance: cac81943-11c4-47b1-8bbc-c34b261f8237] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:36:51.270525 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG dbcounter [-] [124297] Writing DB stats nova_cell0:SELECT=2 {{(pid=124297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:36:51.277463 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-1cb9b53d-7d0e-4baa-a32a-e69c6ae44914 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:51.278014 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-1cb9b53d-7d0e-4baa-a32a-e69c6ae44914 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:51.278999 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-1cb9b53d-7d0e-4baa-a32a-e69c6ae44914 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:51.279537 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-1cb9b53d-7d0e-4baa-a32a-e69c6ae44914 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:51.419358 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-1cb9b53d-7d0e-4baa-a32a-e69c6ae44914 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdc0eeb6cd443d78aefefca488d8c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3eabfe3692b44d8ae5f7d137ce1d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:36:51.427027 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-1cb9b53d-7d0e-4baa-a32a-e69c6ae44914 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] 10.222.0.57 "GET /compute/v2.1/servers/cac81943-11c4-47b1-8bbc-c34b261f8237" status: 200 len: 1319 microversion: 2.1 time: 0.166534 Jun 30 12:36:51.427566 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 231/450] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:36:51 2022] GET /compute/v2.1/servers/cac81943-11c4-47b1-8bbc-c34b261f8237 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:36:51.627322 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-752119d6-0435-4ee5-82cd-358a1ed38a19 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:36:51.627954 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-752119d6-0435-4ee5-82cd-358a1ed38a19 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 99ba3b96-6700-41e0-b2cf-ff8933b2bf94] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:36:51.631011 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG dbcounter [-] [124298] Writing DB stats nova_cell0:SELECT=2 {{(pid=124298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:36:51.632003 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG dbcounter [-] [124298] Writing DB stats nova_cell0:SELECT=6 {{(pid=124298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:36:51.641513 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-752119d6-0435-4ee5-82cd-358a1ed38a19 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:51.641513 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-752119d6-0435-4ee5-82cd-358a1ed38a19 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:51.642571 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-752119d6-0435-4ee5-82cd-358a1ed38a19 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:51.643113 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-752119d6-0435-4ee5-82cd-358a1ed38a19 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:51.787962 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-752119d6-0435-4ee5-82cd-358a1ed38a19 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddb38b4d6864a6c96b84c9a4092eea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60d10dba1d947cc97149a063a810129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:36:51.796072 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-752119d6-0435-4ee5-82cd-358a1ed38a19 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94" status: 200 len: 1676 microversion: 2.1 time: 0.175552 Jun 30 12:36:51.796917 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 220/451] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:36:51 2022] GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94 => generated 1676 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:36:52.445600 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-6d8b1373-c16c-49c3-b7c2-3fec7d270bf0 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:36:52.446249 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-6d8b1373-c16c-49c3-b7c2-3fec7d270bf0 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] [instance: cac81943-11c4-47b1-8bbc-c34b261f8237] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:36:52.456306 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-6d8b1373-c16c-49c3-b7c2-3fec7d270bf0 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:52.457040 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-6d8b1373-c16c-49c3-b7c2-3fec7d270bf0 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:52.458132 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-6d8b1373-c16c-49c3-b7c2-3fec7d270bf0 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:52.458714 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-6d8b1373-c16c-49c3-b7c2-3fec7d270bf0 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:52.595849 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-6d8b1373-c16c-49c3-b7c2-3fec7d270bf0 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdc0eeb6cd443d78aefefca488d8c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3eabfe3692b44d8ae5f7d137ce1d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:36:52.603931 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-6d8b1373-c16c-49c3-b7c2-3fec7d270bf0 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] 10.222.0.57 "GET /compute/v2.1/servers/cac81943-11c4-47b1-8bbc-c34b261f8237" status: 200 len: 1319 microversion: 2.1 time: 0.163708 Jun 30 12:36:52.604507 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 232/452] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:36:52 2022] GET /compute/v2.1/servers/cac81943-11c4-47b1-8bbc-c34b261f8237 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:36:52.818199 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-5ea5a265-3ae9-4690-8fd9-613cb50efc62 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:36:52.819217 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-5ea5a265-3ae9-4690-8fd9-613cb50efc62 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 99ba3b96-6700-41e0-b2cf-ff8933b2bf94] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:36:52.829607 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-5ea5a265-3ae9-4690-8fd9-613cb50efc62 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:52.830061 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-5ea5a265-3ae9-4690-8fd9-613cb50efc62 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:52.830863 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-5ea5a265-3ae9-4690-8fd9-613cb50efc62 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:52.831298 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-5ea5a265-3ae9-4690-8fd9-613cb50efc62 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:52.969302 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-5ea5a265-3ae9-4690-8fd9-613cb50efc62 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddb38b4d6864a6c96b84c9a4092eea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60d10dba1d947cc97149a063a810129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:36:52.977174 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-5ea5a265-3ae9-4690-8fd9-613cb50efc62 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94" status: 200 len: 1676 microversion: 2.1 time: 0.166156 Jun 30 12:36:52.977738 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 221/453] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:36:52 2022] GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94 => generated 1676 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:36:53.623977 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-a3dab375-74b8-4a19-b5f1-7941861f2e58 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:36:53.624758 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-a3dab375-74b8-4a19-b5f1-7941861f2e58 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] [instance: cac81943-11c4-47b1-8bbc-c34b261f8237] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:36:53.634668 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-a3dab375-74b8-4a19-b5f1-7941861f2e58 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:53.635293 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-a3dab375-74b8-4a19-b5f1-7941861f2e58 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:53.636443 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-a3dab375-74b8-4a19-b5f1-7941861f2e58 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:53.637220 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-a3dab375-74b8-4a19-b5f1-7941861f2e58 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:53.771195 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-a3dab375-74b8-4a19-b5f1-7941861f2e58 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdc0eeb6cd443d78aefefca488d8c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3eabfe3692b44d8ae5f7d137ce1d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:36:53.778919 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-a3dab375-74b8-4a19-b5f1-7941861f2e58 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] 10.222.0.57 "GET /compute/v2.1/servers/cac81943-11c4-47b1-8bbc-c34b261f8237" status: 200 len: 1319 microversion: 2.1 time: 0.160704 Jun 30 12:36:53.779484 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 233/454] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:36:53 2022] GET /compute/v2.1/servers/cac81943-11c4-47b1-8bbc-c34b261f8237 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:36:53.998075 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-da4fa0fb-2880-43f1-a563-7ed3a1df96e5 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:36:53.999032 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-da4fa0fb-2880-43f1-a563-7ed3a1df96e5 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 99ba3b96-6700-41e0-b2cf-ff8933b2bf94] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:36:54.006816 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-da4fa0fb-2880-43f1-a563-7ed3a1df96e5 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:54.007263 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-da4fa0fb-2880-43f1-a563-7ed3a1df96e5 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:54.008017 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-da4fa0fb-2880-43f1-a563-7ed3a1df96e5 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:54.008441 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-da4fa0fb-2880-43f1-a563-7ed3a1df96e5 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:54.384239 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-da4fa0fb-2880-43f1-a563-7ed3a1df96e5 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddb38b4d6864a6c96b84c9a4092eea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60d10dba1d947cc97149a063a810129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:36:54.392129 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-da4fa0fb-2880-43f1-a563-7ed3a1df96e5 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94" status: 200 len: 1676 microversion: 2.1 time: 0.399958 Jun 30 12:36:54.392690 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 222/455] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:36:53 2022] GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94 => generated 1676 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:36:54.797688 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-bf0c27f4-0f8a-43d5-870a-561d3e4efb61 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:36:54.798695 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-bf0c27f4-0f8a-43d5-870a-561d3e4efb61 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] [instance: cac81943-11c4-47b1-8bbc-c34b261f8237] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:36:54.808702 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-bf0c27f4-0f8a-43d5-870a-561d3e4efb61 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:54.809356 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-bf0c27f4-0f8a-43d5-870a-561d3e4efb61 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:54.810533 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-bf0c27f4-0f8a-43d5-870a-561d3e4efb61 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:54.811165 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-bf0c27f4-0f8a-43d5-870a-561d3e4efb61 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:54.951492 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-bf0c27f4-0f8a-43d5-870a-561d3e4efb61 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdc0eeb6cd443d78aefefca488d8c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3eabfe3692b44d8ae5f7d137ce1d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:36:54.959692 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-bf0c27f4-0f8a-43d5-870a-561d3e4efb61 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] 10.222.0.57 "GET /compute/v2.1/servers/cac81943-11c4-47b1-8bbc-c34b261f8237" status: 200 len: 1319 microversion: 2.1 time: 0.166938 Jun 30 12:36:54.960268 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 234/456] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:36:54 2022] GET /compute/v2.1/servers/cac81943-11c4-47b1-8bbc-c34b261f8237 => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:36:55.411129 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-7cd63403-9c56-4da3-9965-f53ced86ed8d tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:36:55.413364 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-7cd63403-9c56-4da3-9965-f53ced86ed8d tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 99ba3b96-6700-41e0-b2cf-ff8933b2bf94] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:36:55.422643 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-7cd63403-9c56-4da3-9965-f53ced86ed8d tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:55.423099 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-7cd63403-9c56-4da3-9965-f53ced86ed8d tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:55.423909 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-7cd63403-9c56-4da3-9965-f53ced86ed8d tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:55.424396 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-7cd63403-9c56-4da3-9965-f53ced86ed8d tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:55.549011 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [req-71952698-dc0d-4fb1-95d5-d5c2c8922279 req-0f3d2bee-243e-4e72-b520-51b47683b32b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cac81943-11c4-47b1-8bbc-c34b261f8237", "name": "network-vif-plugged", "status": "completed", "tag": "e06fcd1b-c6e5-430f-aec7-1c5386fcf5e5"}]} {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:36:55.557268 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [req-71952698-dc0d-4fb1-95d5-d5c2c8922279 req-0f3d2bee-243e-4e72-b520-51b47683b32b service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:55.557983 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [req-71952698-dc0d-4fb1-95d5-d5c2c8922279 req-0f3d2bee-243e-4e72-b520-51b47683b32b service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:55.570584 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.compute.server_external_events [req-71952698-dc0d-4fb1-95d5-d5c2c8922279 req-0f3d2bee-243e-4e72-b520-51b47683b32b service nova] Creating event network-vif-plugged:e06fcd1b-c6e5-430f-aec7-1c5386fcf5e5 for instance cac81943-11c4-47b1-8bbc-c34b261f8237 on hv-cinder-84614 Jun 30 12:36:55.570903 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-7cd63403-9c56-4da3-9965-f53ced86ed8d tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddb38b4d6864a6c96b84c9a4092eea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60d10dba1d947cc97149a063a810129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:36:55.576112 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [req-71952698-dc0d-4fb1-95d5-d5c2c8922279 req-0f3d2bee-243e-4e72-b520-51b47683b32b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031240 Jun 30 12:36:55.576733 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 235/457] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 30 12:36:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 12:36:55.580310 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-7cd63403-9c56-4da3-9965-f53ced86ed8d tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94" status: 200 len: 1676 microversion: 2.1 time: 0.174887 Jun 30 12:36:55.581070 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 223/458] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:36:55 2022] GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94 => generated 1676 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:36:55.977864 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-ac4a433d-ed59-45d4-96ad-a55e49ca1304 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:36:55.978569 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-ac4a433d-ed59-45d4-96ad-a55e49ca1304 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] [instance: cac81943-11c4-47b1-8bbc-c34b261f8237] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:36:55.985460 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-ac4a433d-ed59-45d4-96ad-a55e49ca1304 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:55.985906 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-ac4a433d-ed59-45d4-96ad-a55e49ca1304 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:55.986664 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-ac4a433d-ed59-45d4-96ad-a55e49ca1304 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:55.987095 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-ac4a433d-ed59-45d4-96ad-a55e49ca1304 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:56.119917 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-ac4a433d-ed59-45d4-96ad-a55e49ca1304 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdc0eeb6cd443d78aefefca488d8c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3eabfe3692b44d8ae5f7d137ce1d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:36:56.127897 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-ac4a433d-ed59-45d4-96ad-a55e49ca1304 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] 10.222.0.57 "GET /compute/v2.1/servers/cac81943-11c4-47b1-8bbc-c34b261f8237" status: 200 len: 1319 microversion: 2.1 time: 0.154298 Jun 30 12:36:56.128468 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 236/459] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:36:55 2022] GET /compute/v2.1/servers/cac81943-11c4-47b1-8bbc-c34b261f8237 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:36:56.458934 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-65be9694-7303-4772-9fc9-39469bec57f0 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:36:56.459939 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-65be9694-7303-4772-9fc9-39469bec57f0 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: 7f35d48f-59b1-4105-a9ea-a6ffee1b86d0] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:36:56.466861 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-65be9694-7303-4772-9fc9-39469bec57f0 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:56.467307 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-65be9694-7303-4772-9fc9-39469bec57f0 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:56.468197 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-65be9694-7303-4772-9fc9-39469bec57f0 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:56.468653 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-65be9694-7303-4772-9fc9-39469bec57f0 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:56.491533 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.objects.instance [None req-65be9694-7303-4772-9fc9-39469bec57f0 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lazy-loading 'flavor' on Instance uuid 7f35d48f-59b1-4105-a9ea-a6ffee1b86d0 {{(pid=124298) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 12:36:56.597888 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-4607f060-c83a-4968-91e9-b4694bf65d56 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:36:56.598498 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-4607f060-c83a-4968-91e9-b4694bf65d56 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 99ba3b96-6700-41e0-b2cf-ff8933b2bf94] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:36:56.604768 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-4607f060-c83a-4968-91e9-b4694bf65d56 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:56.605211 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-4607f060-c83a-4968-91e9-b4694bf65d56 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:56.606122 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-4607f060-c83a-4968-91e9-b4694bf65d56 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:56.606411 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-4607f060-c83a-4968-91e9-b4694bf65d56 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:56.656705 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-65be9694-7303-4772-9fc9-39469bec57f0 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "POST /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0/action" status: 200 len: 32 microversion: 2.1 time: 0.201694 Jun 30 12:36:56.657355 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 224/460] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Jun 30 12:36:56 2022] POST /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0/action => generated 32 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 30 12:36:56.666931 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-2c2fdff9-9093-4db3-9178-30aeebf7e0ee tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:36:56.667621 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-2c2fdff9-9093-4db3-9178-30aeebf7e0ee tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: 7f35d48f-59b1-4105-a9ea-a6ffee1b86d0] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:36:56.674134 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-2c2fdff9-9093-4db3-9178-30aeebf7e0ee tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:56.674584 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-2c2fdff9-9093-4db3-9178-30aeebf7e0ee tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:56.675415 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-2c2fdff9-9093-4db3-9178-30aeebf7e0ee tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:56.675977 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-2c2fdff9-9093-4db3-9178-30aeebf7e0ee tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:56.784109 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-4607f060-c83a-4968-91e9-b4694bf65d56 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddb38b4d6864a6c96b84c9a4092eea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60d10dba1d947cc97149a063a810129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:36:56.792442 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-4607f060-c83a-4968-91e9-b4694bf65d56 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94" status: 200 len: 1676 microversion: 2.1 time: 0.198436 Jun 30 12:36:56.793089 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 237/461] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:36:56 2022] GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94 => generated 1676 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:36:56.828782 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-2c2fdff9-9093-4db3-9178-30aeebf7e0ee tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:36:56.837068 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-2c2fdff9-9093-4db3-9178-30aeebf7e0ee tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0" status: 200 len: 1734 microversion: 2.1 time: 0.174367 Jun 30 12:36:56.837620 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 225/462] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:36:56 2022] GET /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0 => generated 1734 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 12:36:57.145477 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-37e19955-b35e-45b5-b0cc-a72516bdeaad tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:36:57.146091 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-37e19955-b35e-45b5-b0cc-a72516bdeaad tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] [instance: cac81943-11c4-47b1-8bbc-c34b261f8237] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:36:57.153098 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-37e19955-b35e-45b5-b0cc-a72516bdeaad tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:57.153545 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-37e19955-b35e-45b5-b0cc-a72516bdeaad tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:57.154315 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-37e19955-b35e-45b5-b0cc-a72516bdeaad tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:57.154747 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-37e19955-b35e-45b5-b0cc-a72516bdeaad tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:57.288571 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-37e19955-b35e-45b5-b0cc-a72516bdeaad tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdc0eeb6cd443d78aefefca488d8c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3eabfe3692b44d8ae5f7d137ce1d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:36:57.296916 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-37e19955-b35e-45b5-b0cc-a72516bdeaad tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] 10.222.0.57 "GET /compute/v2.1/servers/cac81943-11c4-47b1-8bbc-c34b261f8237" status: 200 len: 1319 microversion: 2.1 time: 0.155369 Jun 30 12:36:57.297485 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 238/463] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:36:57 2022] GET /compute/v2.1/servers/cac81943-11c4-47b1-8bbc-c34b261f8237 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:36:57.813165 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-2568363f-7a13-4cd8-a477-e6f241da9ced tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:36:57.813997 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-2568363f-7a13-4cd8-a477-e6f241da9ced tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 99ba3b96-6700-41e0-b2cf-ff8933b2bf94] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:36:57.820624 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-2568363f-7a13-4cd8-a477-e6f241da9ced tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:57.821131 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-2568363f-7a13-4cd8-a477-e6f241da9ced tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:57.821963 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-2568363f-7a13-4cd8-a477-e6f241da9ced tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:57.822419 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-2568363f-7a13-4cd8-a477-e6f241da9ced tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:57.855131 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-c74ccd14-73a2-407a-8c14-b9dbbe1e3b04 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:36:57.856059 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-c74ccd14-73a2-407a-8c14-b9dbbe1e3b04 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: 7f35d48f-59b1-4105-a9ea-a6ffee1b86d0] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:36:57.863949 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-c74ccd14-73a2-407a-8c14-b9dbbe1e3b04 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:57.864781 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-c74ccd14-73a2-407a-8c14-b9dbbe1e3b04 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:57.865715 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-c74ccd14-73a2-407a-8c14-b9dbbe1e3b04 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:57.867273 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-c74ccd14-73a2-407a-8c14-b9dbbe1e3b04 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:58.033107 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-2568363f-7a13-4cd8-a477-e6f241da9ced tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddb38b4d6864a6c96b84c9a4092eea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60d10dba1d947cc97149a063a810129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:36:58.043022 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-2568363f-7a13-4cd8-a477-e6f241da9ced tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94" status: 200 len: 1676 microversion: 2.1 time: 0.235785 Jun 30 12:36:58.043693 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 226/464] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:36:57 2022] GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94 => generated 1676 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:36:58.060679 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-c74ccd14-73a2-407a-8c14-b9dbbe1e3b04 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:36:58.069577 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-c74ccd14-73a2-407a-8c14-b9dbbe1e3b04 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0" status: 200 len: 1734 microversion: 2.1 time: 0.218471 Jun 30 12:36:58.070195 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 239/465] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:36:57 2022] GET /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0 => generated 1734 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:36:58.317402 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-f5229290-8303-4edf-b0a3-54fc1e66ff18 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:36:58.318402 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-f5229290-8303-4edf-b0a3-54fc1e66ff18 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] [instance: cac81943-11c4-47b1-8bbc-c34b261f8237] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:36:58.329106 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-f5229290-8303-4edf-b0a3-54fc1e66ff18 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:58.329842 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-f5229290-8303-4edf-b0a3-54fc1e66ff18 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:58.331092 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-f5229290-8303-4edf-b0a3-54fc1e66ff18 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:58.331803 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-f5229290-8303-4edf-b0a3-54fc1e66ff18 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:58.478206 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-f5229290-8303-4edf-b0a3-54fc1e66ff18 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdc0eeb6cd443d78aefefca488d8c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3eabfe3692b44d8ae5f7d137ce1d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:36:58.486516 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-f5229290-8303-4edf-b0a3-54fc1e66ff18 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] 10.222.0.57 "GET /compute/v2.1/servers/cac81943-11c4-47b1-8bbc-c34b261f8237" status: 200 len: 1507 microversion: 2.1 time: 0.175899 Jun 30 12:36:58.487099 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 227/466] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:36:58 2022] GET /compute/v2.1/servers/cac81943-11c4-47b1-8bbc-c34b261f8237 => generated 1507 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:36:59.065207 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-fedb4ade-1f57-4aef-9c1e-b4fb84025bdb tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:36:59.065728 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-fedb4ade-1f57-4aef-9c1e-b4fb84025bdb tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 99ba3b96-6700-41e0-b2cf-ff8933b2bf94] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:36:59.072390 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-fedb4ade-1f57-4aef-9c1e-b4fb84025bdb tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:59.072868 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-fedb4ade-1f57-4aef-9c1e-b4fb84025bdb tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:59.073630 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-fedb4ade-1f57-4aef-9c1e-b4fb84025bdb tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:59.074057 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-fedb4ade-1f57-4aef-9c1e-b4fb84025bdb tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:59.089075 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-5fedcba8-795c-46c7-b542-984094e616eb tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:36:59.089690 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-5fedcba8-795c-46c7-b542-984094e616eb tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: 7f35d48f-59b1-4105-a9ea-a6ffee1b86d0] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:36:59.097528 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-5fedcba8-795c-46c7-b542-984094e616eb tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:59.097968 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-5fedcba8-795c-46c7-b542-984094e616eb tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:59.098736 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-5fedcba8-795c-46c7-b542-984094e616eb tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:36:59.099286 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-5fedcba8-795c-46c7-b542-984094e616eb tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:36:59.283785 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-fedb4ade-1f57-4aef-9c1e-b4fb84025bdb tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddb38b4d6864a6c96b84c9a4092eea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60d10dba1d947cc97149a063a810129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:36:59.286369 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-5fedcba8-795c-46c7-b542-984094e616eb tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:36:59.291994 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-fedb4ade-1f57-4aef-9c1e-b4fb84025bdb tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94" status: 200 len: 1676 microversion: 2.1 time: 0.233294 Jun 30 12:36:59.292566 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 240/467] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:36:59 2022] GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94 => generated 1676 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:36:59.294978 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-5fedcba8-795c-46c7-b542-984094e616eb tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0" status: 200 len: 1734 microversion: 2.1 time: 0.211891 Jun 30 12:36:59.295531 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 228/468] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:36:59 2022] GET /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0 => generated 1734 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:37:00.314454 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-48826ec2-b9d7-4fcf-b62d-30f72b92967e tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:37:00.315607 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-48826ec2-b9d7-4fcf-b62d-30f72b92967e tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 99ba3b96-6700-41e0-b2cf-ff8933b2bf94] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:37:00.317719 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-d6675a94-f333-4587-96d8-14cea506faa9 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:37:00.318900 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-d6675a94-f333-4587-96d8-14cea506faa9 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: 7f35d48f-59b1-4105-a9ea-a6ffee1b86d0] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:37:00.327179 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-48826ec2-b9d7-4fcf-b62d-30f72b92967e tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:00.328757 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-48826ec2-b9d7-4fcf-b62d-30f72b92967e tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:00.329246 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-d6675a94-f333-4587-96d8-14cea506faa9 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:00.329501 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-48826ec2-b9d7-4fcf-b62d-30f72b92967e tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:00.329677 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-d6675a94-f333-4587-96d8-14cea506faa9 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:00.329945 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-48826ec2-b9d7-4fcf-b62d-30f72b92967e tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:00.330475 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-d6675a94-f333-4587-96d8-14cea506faa9 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:00.330887 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-d6675a94-f333-4587-96d8-14cea506faa9 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:00.350903 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG dbcounter [-] [124298] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:00.530036 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-d6675a94-f333-4587-96d8-14cea506faa9 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:37:00.533023 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-48826ec2-b9d7-4fcf-b62d-30f72b92967e tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddb38b4d6864a6c96b84c9a4092eea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60d10dba1d947cc97149a063a810129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:37:00.541299 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-48826ec2-b9d7-4fcf-b62d-30f72b92967e tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94" status: 200 len: 1653 microversion: 2.1 time: 0.233934 Jun 30 12:37:00.541926 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 241/469] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:37:00 2022] GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94 => generated 1653 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:37:00.543437 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-d6675a94-f333-4587-96d8-14cea506faa9 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0" status: 200 len: 1734 microversion: 2.1 time: 0.233279 Jun 30 12:37:00.544017 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 229/470] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:37:00 2022] GET /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0 => generated 1734 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:37:00.558400 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-8bf31d6b-a1d3-4d73-94da-ea2d36601c8a tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:37:00.564726 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-8bf31d6b-a1d3-4d73-94da-ea2d36601c8a tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:00.565166 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-8bf31d6b-a1d3-4d73-94da-ea2d36601c8a tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:00.618718 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG dbcounter [-] [124297] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:00.624200 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-8bf31d6b-a1d3-4d73-94da-ea2d36601c8a tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 99ba3b96-6700-41e0-b2cf-ff8933b2bf94] Going to try to start instance {{(pid=124297) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 30 12:37:00.669242 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-8bf31d6b-a1d3-4d73-94da-ea2d36601c8a tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "POST /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94/action" status: 202 len: 0 microversion: 2.1 time: 0.114348 Jun 30 12:37:00.673292 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 242/471] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Jun 30 12:37:00 2022] POST /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 12:37:00.679579 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-0b610df7-7a57-4a1b-9191-93bb41af2b8c tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:37:00.680250 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-0b610df7-7a57-4a1b-9191-93bb41af2b8c tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 99ba3b96-6700-41e0-b2cf-ff8933b2bf94] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:37:00.686766 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-0b610df7-7a57-4a1b-9191-93bb41af2b8c tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:00.687251 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-0b610df7-7a57-4a1b-9191-93bb41af2b8c tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:00.688056 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-0b610df7-7a57-4a1b-9191-93bb41af2b8c tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:00.688594 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-0b610df7-7a57-4a1b-9191-93bb41af2b8c tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:00.829648 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-0b610df7-7a57-4a1b-9191-93bb41af2b8c tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddb38b4d6864a6c96b84c9a4092eea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60d10dba1d947cc97149a063a810129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:37:00.837727 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-0b610df7-7a57-4a1b-9191-93bb41af2b8c tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94" status: 200 len: 1662 microversion: 2.1 time: 0.162930 Jun 30 12:37:00.838291 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 230/472] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:37:00 2022] GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94 => generated 1662 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 12:37:01.563081 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-16ceaef9-384b-4f45-92a1-8ba87011f146 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:37:01.563801 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-16ceaef9-384b-4f45-92a1-8ba87011f146 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: 7f35d48f-59b1-4105-a9ea-a6ffee1b86d0] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:37:01.571006 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-16ceaef9-384b-4f45-92a1-8ba87011f146 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:01.571453 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-16ceaef9-384b-4f45-92a1-8ba87011f146 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:01.572207 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-16ceaef9-384b-4f45-92a1-8ba87011f146 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:01.572650 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-16ceaef9-384b-4f45-92a1-8ba87011f146 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:01.714539 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-16ceaef9-384b-4f45-92a1-8ba87011f146 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:37:01.722651 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-16ceaef9-384b-4f45-92a1-8ba87011f146 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0" status: 200 len: 1734 microversion: 2.1 time: 0.164427 Jun 30 12:37:01.723388 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 243/473] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:37:01 2022] GET /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0 => generated 1734 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:37:01.855236 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-175a6272-53cf-4fd7-8092-88871f0ccb08 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:37:01.855800 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-175a6272-53cf-4fd7-8092-88871f0ccb08 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 99ba3b96-6700-41e0-b2cf-ff8933b2bf94] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:37:01.864668 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-175a6272-53cf-4fd7-8092-88871f0ccb08 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:01.865108 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-175a6272-53cf-4fd7-8092-88871f0ccb08 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:01.865869 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-175a6272-53cf-4fd7-8092-88871f0ccb08 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:01.866289 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-175a6272-53cf-4fd7-8092-88871f0ccb08 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:02.012653 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-175a6272-53cf-4fd7-8092-88871f0ccb08 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddb38b4d6864a6c96b84c9a4092eea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60d10dba1d947cc97149a063a810129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:37:02.021894 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-175a6272-53cf-4fd7-8092-88871f0ccb08 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94" status: 200 len: 1662 microversion: 2.1 time: 0.170549 Jun 30 12:37:02.022467 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 231/474] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:37:01 2022] GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94 => generated 1662 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:37:02.739562 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-8dbe909e-23f9-4d7c-bfea-101b0cfd2608 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:37:02.740191 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-8dbe909e-23f9-4d7c-bfea-101b0cfd2608 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: 7f35d48f-59b1-4105-a9ea-a6ffee1b86d0] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:37:02.747031 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-8dbe909e-23f9-4d7c-bfea-101b0cfd2608 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:02.747472 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-8dbe909e-23f9-4d7c-bfea-101b0cfd2608 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:02.748237 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-8dbe909e-23f9-4d7c-bfea-101b0cfd2608 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:02.748665 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-8dbe909e-23f9-4d7c-bfea-101b0cfd2608 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:02.884280 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-8dbe909e-23f9-4d7c-bfea-101b0cfd2608 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:37:02.896692 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-8dbe909e-23f9-4d7c-bfea-101b0cfd2608 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0" status: 200 len: 1734 microversion: 2.1 time: 0.160786 Jun 30 12:37:02.897370 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 244/475] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:37:02 2022] GET /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0 => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:37:03.040926 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-6e413474-df83-4716-9d65-1c5f3bf6ba5a tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:37:03.041501 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-6e413474-df83-4716-9d65-1c5f3bf6ba5a tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 99ba3b96-6700-41e0-b2cf-ff8933b2bf94] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:37:03.048483 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-6e413474-df83-4716-9d65-1c5f3bf6ba5a tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:03.048963 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-6e413474-df83-4716-9d65-1c5f3bf6ba5a tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:03.050009 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-6e413474-df83-4716-9d65-1c5f3bf6ba5a tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:03.050445 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-6e413474-df83-4716-9d65-1c5f3bf6ba5a tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:03.189773 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-6e413474-df83-4716-9d65-1c5f3bf6ba5a tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddb38b4d6864a6c96b84c9a4092eea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60d10dba1d947cc97149a063a810129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:37:03.198186 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-6e413474-df83-4716-9d65-1c5f3bf6ba5a tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94" status: 200 len: 1666 microversion: 2.1 time: 0.161710 Jun 30 12:37:03.198780 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 232/476] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:37:03 2022] GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94 => generated 1666 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:37:03.919086 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-850aef50-3dc0-460e-95d4-4eae0484f8cf tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:37:03.919637 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-850aef50-3dc0-460e-95d4-4eae0484f8cf tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: 7f35d48f-59b1-4105-a9ea-a6ffee1b86d0] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:37:03.926741 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-850aef50-3dc0-460e-95d4-4eae0484f8cf tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:03.927423 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-850aef50-3dc0-460e-95d4-4eae0484f8cf tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:03.928153 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-850aef50-3dc0-460e-95d4-4eae0484f8cf tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:03.928577 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-850aef50-3dc0-460e-95d4-4eae0484f8cf tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:04.083694 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-850aef50-3dc0-460e-95d4-4eae0484f8cf tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:37:04.092977 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-850aef50-3dc0-460e-95d4-4eae0484f8cf tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0" status: 200 len: 1734 microversion: 2.1 time: 0.177879 Jun 30 12:37:04.093521 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 245/477] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:37:03 2022] GET /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0 => generated 1734 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:37:05.114670 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-4e270704-aea9-4f67-aa51-7e310664c199 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:37:05.115813 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-4e270704-aea9-4f67-aa51-7e310664c199 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: 7f35d48f-59b1-4105-a9ea-a6ffee1b86d0] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:37:05.120258 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG dbcounter [-] [124298] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=124298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:05.132521 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-4e270704-aea9-4f67-aa51-7e310664c199 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:05.132824 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-4e270704-aea9-4f67-aa51-7e310664c199 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:05.133551 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-4e270704-aea9-4f67-aa51-7e310664c199 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:05.133985 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-4e270704-aea9-4f67-aa51-7e310664c199 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:05.271187 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-4e270704-aea9-4f67-aa51-7e310664c199 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:37:05.281166 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-4e270704-aea9-4f67-aa51-7e310664c199 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0" status: 200 len: 1734 microversion: 2.1 time: 0.173141 Jun 30 12:37:05.281883 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 233/478] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:37:05 2022] GET /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0 => generated 1734 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:37:06.299538 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-12adb948-e326-4925-9338-7e9c80b75e04 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:37:06.300841 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-12adb948-e326-4925-9338-7e9c80b75e04 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: 7f35d48f-59b1-4105-a9ea-a6ffee1b86d0] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:37:06.303400 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG dbcounter [-] [124297] Writing DB stats nova_api:SELECT=58 {{(pid=124297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:06.309514 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-12adb948-e326-4925-9338-7e9c80b75e04 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:06.310257 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-12adb948-e326-4925-9338-7e9c80b75e04 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:06.311289 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-12adb948-e326-4925-9338-7e9c80b75e04 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:06.311726 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-12adb948-e326-4925-9338-7e9c80b75e04 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:06.452851 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-12adb948-e326-4925-9338-7e9c80b75e04 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:37:06.466229 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-12adb948-e326-4925-9338-7e9c80b75e04 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0" status: 200 len: 1734 microversion: 2.1 time: 0.168899 Jun 30 12:37:06.466229 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 246/479] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:37:06 2022] GET /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0 => generated 1734 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:37:07.487276 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-c8ac4aac-5def-4ef0-96d2-671194fbc3c2 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:37:07.488183 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-c8ac4aac-5def-4ef0-96d2-671194fbc3c2 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: 7f35d48f-59b1-4105-a9ea-a6ffee1b86d0] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:37:07.497977 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-c8ac4aac-5def-4ef0-96d2-671194fbc3c2 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:07.498424 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-c8ac4aac-5def-4ef0-96d2-671194fbc3c2 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:07.499207 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-c8ac4aac-5def-4ef0-96d2-671194fbc3c2 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:07.499642 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-c8ac4aac-5def-4ef0-96d2-671194fbc3c2 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:07.635960 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-c8ac4aac-5def-4ef0-96d2-671194fbc3c2 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:37:07.644034 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-c8ac4aac-5def-4ef0-96d2-671194fbc3c2 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0" status: 200 len: 1734 microversion: 2.1 time: 0.162812 Jun 30 12:37:07.644604 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 234/480] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:37:07 2022] GET /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0 => generated 1734 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:37:08.666624 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-00544f12-3cde-42ab-babb-46f0a28f55aa tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:37:08.667577 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-00544f12-3cde-42ab-babb-46f0a28f55aa tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: 7f35d48f-59b1-4105-a9ea-a6ffee1b86d0] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:37:08.678578 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-00544f12-3cde-42ab-babb-46f0a28f55aa tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:08.679315 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-00544f12-3cde-42ab-babb-46f0a28f55aa tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:08.680565 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-00544f12-3cde-42ab-babb-46f0a28f55aa tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:08.681339 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-00544f12-3cde-42ab-babb-46f0a28f55aa tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:08.831387 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-00544f12-3cde-42ab-babb-46f0a28f55aa tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:37:08.843341 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-00544f12-3cde-42ab-babb-46f0a28f55aa tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0" status: 200 len: 1734 microversion: 2.1 time: 0.183480 Jun 30 12:37:08.843678 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 247/481] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:37:08 2022] GET /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0 => generated 1734 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:37:09.866850 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-3d715c38-0c52-4fe7-99fa-6fd03a291ac4 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:37:09.867494 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-3d715c38-0c52-4fe7-99fa-6fd03a291ac4 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: 7f35d48f-59b1-4105-a9ea-a6ffee1b86d0] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:37:09.875677 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-3d715c38-0c52-4fe7-99fa-6fd03a291ac4 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:09.876127 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-3d715c38-0c52-4fe7-99fa-6fd03a291ac4 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:09.876940 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-3d715c38-0c52-4fe7-99fa-6fd03a291ac4 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:09.877377 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-3d715c38-0c52-4fe7-99fa-6fd03a291ac4 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:10.016060 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-3d715c38-0c52-4fe7-99fa-6fd03a291ac4 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:37:10.024237 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-3d715c38-0c52-4fe7-99fa-6fd03a291ac4 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0" status: 200 len: 1734 microversion: 2.1 time: 0.162072 Jun 30 12:37:10.024849 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 235/482] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:37:09 2022] GET /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0 => generated 1734 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:37:11.046419 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-c7731d3c-0ddd-44a5-8995-3e17713bc4f0 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:37:11.047440 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-c7731d3c-0ddd-44a5-8995-3e17713bc4f0 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: 7f35d48f-59b1-4105-a9ea-a6ffee1b86d0] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:37:11.056308 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-c7731d3c-0ddd-44a5-8995-3e17713bc4f0 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:11.056897 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-c7731d3c-0ddd-44a5-8995-3e17713bc4f0 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:11.057797 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-c7731d3c-0ddd-44a5-8995-3e17713bc4f0 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:11.058280 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-c7731d3c-0ddd-44a5-8995-3e17713bc4f0 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:11.198202 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-c7731d3c-0ddd-44a5-8995-3e17713bc4f0 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:37:11.207206 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-c7731d3c-0ddd-44a5-8995-3e17713bc4f0 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0" status: 200 len: 1734 microversion: 2.1 time: 0.167313 Jun 30 12:37:11.207743 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 248/483] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:37:11 2022] GET /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0 => generated 1734 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:37:12.227314 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-8d319237-95be-469b-9cc0-c98d988c5d86 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:37:12.228181 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-8d319237-95be-469b-9cc0-c98d988c5d86 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: 7f35d48f-59b1-4105-a9ea-a6ffee1b86d0] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:37:12.238776 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-8d319237-95be-469b-9cc0-c98d988c5d86 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:12.239475 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-8d319237-95be-469b-9cc0-c98d988c5d86 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:12.240695 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-8d319237-95be-469b-9cc0-c98d988c5d86 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:12.241366 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-8d319237-95be-469b-9cc0-c98d988c5d86 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:12.383457 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-8d319237-95be-469b-9cc0-c98d988c5d86 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:37:12.391944 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-8d319237-95be-469b-9cc0-c98d988c5d86 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0" status: 200 len: 1734 microversion: 2.1 time: 0.170629 Jun 30 12:37:12.392702 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 236/484] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:37:12 2022] GET /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0 => generated 1734 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:37:13.410426 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-4a2c1d0b-979c-45b4-a5fc-588c242cc4bb tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:37:13.411094 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-4a2c1d0b-979c-45b4-a5fc-588c242cc4bb tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: 7f35d48f-59b1-4105-a9ea-a6ffee1b86d0] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:37:13.419603 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-4a2c1d0b-979c-45b4-a5fc-588c242cc4bb tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:13.420135 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-4a2c1d0b-979c-45b4-a5fc-588c242cc4bb tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:13.421092 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-4a2c1d0b-979c-45b4-a5fc-588c242cc4bb tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:13.421596 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-4a2c1d0b-979c-45b4-a5fc-588c242cc4bb tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:13.570921 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-4a2c1d0b-979c-45b4-a5fc-588c242cc4bb tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:37:13.583200 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-4a2c1d0b-979c-45b4-a5fc-588c242cc4bb tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0" status: 200 len: 1734 microversion: 2.1 time: 0.177167 Jun 30 12:37:13.584151 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 249/485] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:37:13 2022] GET /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0 => generated 1734 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:37:14.609264 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-d5ba23bd-1ed9-41ed-b60e-acd9df6d2c8c tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:37:14.610127 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-d5ba23bd-1ed9-41ed-b60e-acd9df6d2c8c tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: 7f35d48f-59b1-4105-a9ea-a6ffee1b86d0] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:37:14.622079 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-d5ba23bd-1ed9-41ed-b60e-acd9df6d2c8c tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:14.622811 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-d5ba23bd-1ed9-41ed-b60e-acd9df6d2c8c tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:14.624050 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-d5ba23bd-1ed9-41ed-b60e-acd9df6d2c8c tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:14.624810 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-d5ba23bd-1ed9-41ed-b60e-acd9df6d2c8c tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:14.766053 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-d5ba23bd-1ed9-41ed-b60e-acd9df6d2c8c tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:37:14.774367 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-d5ba23bd-1ed9-41ed-b60e-acd9df6d2c8c tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0" status: 200 len: 1734 microversion: 2.1 time: 0.171894 Jun 30 12:37:14.774936 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 237/486] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:37:14 2022] GET /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0 => generated 1734 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:37:15.791871 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-24ff1f8a-3d73-4f57-8adc-cfcb4af9f1df tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:37:15.792483 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-24ff1f8a-3d73-4f57-8adc-cfcb4af9f1df tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: 7f35d48f-59b1-4105-a9ea-a6ffee1b86d0] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:37:15.799529 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-24ff1f8a-3d73-4f57-8adc-cfcb4af9f1df tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:15.799950 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-24ff1f8a-3d73-4f57-8adc-cfcb4af9f1df tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:15.800795 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-24ff1f8a-3d73-4f57-8adc-cfcb4af9f1df tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:15.801226 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-24ff1f8a-3d73-4f57-8adc-cfcb4af9f1df tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:15.938610 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-24ff1f8a-3d73-4f57-8adc-cfcb4af9f1df tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:37:15.947352 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-24ff1f8a-3d73-4f57-8adc-cfcb4af9f1df tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0" status: 200 len: 1734 microversion: 2.1 time: 0.159813 Jun 30 12:37:15.947922 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 250/487] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:37:15 2022] GET /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0 => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:37:16.865254 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-ff6483a5-ec52-4e8e-9c25-97cca83bed2e tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2fa0c886-7bd5-4f10-ac32-591d859ec421", "device": "/dev/sdb"}} {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:37:16.866916 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-ff6483a5-ec52-4e8e-9c25-97cca83bed2e tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] [instance: cac81943-11c4-47b1-8bbc-c34b261f8237] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:37:16.873675 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-ff6483a5-ec52-4e8e-9c25-97cca83bed2e tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:16.874126 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-ff6483a5-ec52-4e8e-9c25-97cca83bed2e tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:16.874890 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-ff6483a5-ec52-4e8e-9c25-97cca83bed2e tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:16.875307 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-ff6483a5-ec52-4e8e-9c25-97cca83bed2e tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:16.965166 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-9e59a31d-07b3-4ff9-9920-2a3e12243253 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:37:16.965749 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-9e59a31d-07b3-4ff9-9920-2a3e12243253 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: 7f35d48f-59b1-4105-a9ea-a6ffee1b86d0] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:37:16.972678 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-9e59a31d-07b3-4ff9-9920-2a3e12243253 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:16.973155 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-9e59a31d-07b3-4ff9-9920-2a3e12243253 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:16.973969 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-9e59a31d-07b3-4ff9-9920-2a3e12243253 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:16.974411 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-9e59a31d-07b3-4ff9-9920-2a3e12243253 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:17.115020 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-9e59a31d-07b3-4ff9-9920-2a3e12243253 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:37:17.123165 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-9e59a31d-07b3-4ff9-9920-2a3e12243253 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0" status: 200 len: 1734 microversion: 2.1 time: 0.161867 Jun 30 12:37:17.123758 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 251/488] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:37:16 2022] GET /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0 => generated 1734 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:37:17.974465 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-ff6483a5-ec52-4e8e-9c25-97cca83bed2e tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] 10.222.0.57 "POST /compute/v2.1/servers/cac81943-11c4-47b1-8bbc-c34b261f8237/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.113660 Jun 30 12:37:17.975412 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 238/489] 10.222.0.57 () {60 vars in 1322 bytes} [Thu Jun 30 12:37:16 2022] POST /compute/v2.1/servers/cac81943-11c4-47b1-8bbc-c34b261f8237/os-volume_attachments => generated 194 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:37:18.140975 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-db071d78-9fe9-4bcc-8a9c-92ef0f6361ea tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:37:18.141568 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-db071d78-9fe9-4bcc-8a9c-92ef0f6361ea tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: 7f35d48f-59b1-4105-a9ea-a6ffee1b86d0] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:37:18.148461 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-db071d78-9fe9-4bcc-8a9c-92ef0f6361ea tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:18.148948 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-db071d78-9fe9-4bcc-8a9c-92ef0f6361ea tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:18.149716 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-db071d78-9fe9-4bcc-8a9c-92ef0f6361ea tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:18.150147 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-db071d78-9fe9-4bcc-8a9c-92ef0f6361ea tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:18.284659 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-db071d78-9fe9-4bcc-8a9c-92ef0f6361ea tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:37:18.293713 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-db071d78-9fe9-4bcc-8a9c-92ef0f6361ea tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0" status: 200 len: 1714 microversion: 2.1 time: 0.156727 Jun 30 12:37:18.294284 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 252/490] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:37:18 2022] GET /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0 => generated 1714 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:37:18.408161 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-f14cc4c1-ee06-4047-8084-bab6159c65cc tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:37:18.408767 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-f14cc4c1-ee06-4047-8084-bab6159c65cc tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: 7f35d48f-59b1-4105-a9ea-a6ffee1b86d0] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:37:18.415836 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-f14cc4c1-ee06-4047-8084-bab6159c65cc tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:18.416280 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-f14cc4c1-ee06-4047-8084-bab6159c65cc tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:18.417080 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-f14cc4c1-ee06-4047-8084-bab6159c65cc tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:18.417515 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-f14cc4c1-ee06-4047-8084-bab6159c65cc tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:18.556693 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.wsgi [None req-f14cc4c1-ee06-4047-8084-bab6159c65cc tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] HTTP exception thrown: Cannot 'detach_volume' instance 7f35d48f-59b1-4105-a9ea-a6ffee1b86d0 while it is in vm_state rescued Jun 30 12:37:18.558338 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-f14cc4c1-ee06-4047-8084-bab6159c65cc tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Request method failure captured: Jun 30 12:37:18.558338 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: request: DELETE /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0/os-volume_attachments/944feb9e-e424-4f80-979c-b821a2c9bde6 HTTP/1.1 Jun 30 12:37:18.558338 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Accept: application/json Jun 30 12:37:18.558338 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Accept-Encoding: identity Jun 30 12:37:18.558338 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Connection: close Jun 30 12:37:18.558338 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Content-Length: 0 Jun 30 12:37:18.558338 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Content-Type: application/json Jun 30 12:37:18.558338 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Host: 10.222.0.57 Jun 30 12:37:18.558338 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Openstack-System-Scope: None Jun 30 12:37:18.558338 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: User-Agent: python-urllib3/1.26.9 Jun 30 12:37:18.558338 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Auth-Token: gAAAAABivZf_BQGmfS0HOoL_I4T5VOYxBuxZGY2QWD4EHtWbjr8O76qqmYfKKC4FlZ72eOwJFTdgHeD24bmk91RgL5Xpb2Vmu8gdl5stiFwB3gOIKDDDppLMeT3KoEQDYGRtO6bS_AC7MydPE6Kd2zAsainH0ZDMCZDu5MtfqV2V5srDhTVvC8U Jun 30 12:37:18.558338 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Domain-Id: None Jun 30 12:37:18.558338 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Domain-Name: None Jun 30 12:37:18.558338 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Identity-Status: Confirmed Jun 30 12:37:18.558338 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Is-Admin-Project: True Jun 30 12:37:18.558338 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Domain-Id: default Jun 30 12:37:18.558338 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Domain-Name: Default Jun 30 12:37:18.558338 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Id: 663ec7a59bc147299f904d93d119c5e7 Jun 30 12:37:18.558338 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1641653126 Jun 30 12:37:18.558338 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Role: member,reader Jun 30 12:37:18.558338 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Roles: member,reader Jun 30 12:37:18.559778 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/663ec7a59bc147299f904d93d119c5e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/663ec7a59bc147299f904d93d119c5e7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_663ec7a59bc147299f904d93d119c5e7", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/663ec7a59bc147299f904d93d119c5e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 30 12:37:18.559778 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1641653126 Jun 30 12:37:18.559778 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant-Id: 663ec7a59bc147299f904d93d119c5e7 Jun 30 12:37:18.559778 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1641653126 Jun 30 12:37:18.559778 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User: tempest-ServerRescueNegativeTestJSON-1641653126-project Jun 30 12:37:18.559778 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Domain-Id: default Jun 30 12:37:18.559778 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Domain-Name: Default Jun 30 12:37:18.559778 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Id: 26807e5e7aab425eb28e781289794265 Jun 30 12:37:18.559778 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1641653126-project Jun 30 12:37:18.559778 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: method: > Jun 30 12:37:18.559778 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: exception: Cannot 'detach_volume' instance 7f35d48f-59b1-4105-a9ea-a6ffee1b86d0 while it is in vm_state rescued Jun 30 12:37:18.560548 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: action_args: {'server_id': '7f35d48f-59b1-4105-a9ea-a6ffee1b86d0', 'id': '944feb9e-e424-4f80-979c-b821a2c9bde6'} Jun 30 12:37:18.560548 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 12:37:18.560548 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:37:18.560548 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 30 12:37:18.560548 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 30 12:37:18.560548 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 30 12:37:18.560548 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 30 12:37:18.560548 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 30 12:37:18.560548 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 30 12:37:18.560548 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7f35d48f-59b1-4105-a9ea-a6ffee1b86d0 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 30 12:37:18.560548 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:37:18.560548 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:37:18.560548 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:37:18.560548 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:37:18.560548 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:37:18.560548 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:37:18.560548 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 12:37:18.560548 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 12:37:18.560548 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 12:37:18.560548 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 12:37:18.562254 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 30 12:37:18.562254 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 30 12:37:18.562254 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 30 12:37:18.562254 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 30 12:37:18.562254 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 7f35d48f-59b1-4105-a9ea-a6ffee1b86d0 while it is in vm_state rescued Jun 30 12:37:18.562254 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:37:18.562254 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:37:18.562254 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:37:18.562254 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:37:18.562254 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:37:18.562254 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:37:18.562254 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 12:37:18.562254 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 12:37:18.562254 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 7f35d48f-59b1-4105-a9ea-a6ffee1b86d0 while it is in vm_state rescued Jun 30 12:37:18.562254 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:37:18.562254 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-f14cc4c1-ee06-4047-8084-bab6159c65cc tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Returning 409 to user: Cannot 'detach_volume' instance 7f35d48f-59b1-4105-a9ea-a6ffee1b86d0 while it is in vm_state rescued {{(pid=124298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 12:37:18.563889 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-f14cc4c1-ee06-4047-8084-bab6159c65cc tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "DELETE /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0/os-volume_attachments/944feb9e-e424-4f80-979c-b821a2c9bde6" status: 409 len: 152 microversion: 2.1 time: 0.156579 Jun 30 12:37:18.563889 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 239/491] 10.222.0.57 () {58 vars in 1415 bytes} [Thu Jun 30 12:37:18 2022] DELETE /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0/os-volume_attachments/944feb9e-e424-4f80-979c-b821a2c9bde6 => generated 152 bytes in 158 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 30 12:37:18.571066 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-115acde5-5446-48a0-97c9-eb90d9d12c51 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:37:18.571601 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-115acde5-5446-48a0-97c9-eb90d9d12c51 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: 7f35d48f-59b1-4105-a9ea-a6ffee1b86d0] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:37:18.578201 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-115acde5-5446-48a0-97c9-eb90d9d12c51 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:18.578655 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-115acde5-5446-48a0-97c9-eb90d9d12c51 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:18.579420 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-115acde5-5446-48a0-97c9-eb90d9d12c51 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:18.579875 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-115acde5-5446-48a0-97c9-eb90d9d12c51 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:18.653486 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-115acde5-5446-48a0-97c9-eb90d9d12c51 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "POST /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0/action" status: 202 len: 0 microversion: 2.1 time: 0.086869 Jun 30 12:37:18.654121 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 253/492] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Jun 30 12:37:18 2022] POST /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 12:37:18.662714 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-6fb0c987-b1f5-46c2-b75e-42327c3ad413 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:37:18.663691 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-6fb0c987-b1f5-46c2-b75e-42327c3ad413 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: 7f35d48f-59b1-4105-a9ea-a6ffee1b86d0] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:37:18.670846 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-6fb0c987-b1f5-46c2-b75e-42327c3ad413 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:18.671299 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-6fb0c987-b1f5-46c2-b75e-42327c3ad413 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:18.672070 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-6fb0c987-b1f5-46c2-b75e-42327c3ad413 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:18.672510 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-6fb0c987-b1f5-46c2-b75e-42327c3ad413 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:18.811779 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-6fb0c987-b1f5-46c2-b75e-42327c3ad413 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:37:18.820293 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-6fb0c987-b1f5-46c2-b75e-42327c3ad413 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0" status: 200 len: 1722 microversion: 2.1 time: 0.161690 Jun 30 12:37:18.820908 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 240/493] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:37:18 2022] GET /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:37:19.851460 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-c29a41e0-a100-43a6-a584-b9b28a9af915 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:37:19.852372 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-c29a41e0-a100-43a6-a584-b9b28a9af915 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: 7f35d48f-59b1-4105-a9ea-a6ffee1b86d0] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:37:19.861225 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-c29a41e0-a100-43a6-a584-b9b28a9af915 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:19.861825 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-c29a41e0-a100-43a6-a584-b9b28a9af915 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:19.862852 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-c29a41e0-a100-43a6-a584-b9b28a9af915 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:19.863433 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-c29a41e0-a100-43a6-a584-b9b28a9af915 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:20.008254 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-c29a41e0-a100-43a6-a584-b9b28a9af915 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:37:20.017145 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-c29a41e0-a100-43a6-a584-b9b28a9af915 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0" status: 200 len: 1722 microversion: 2.1 time: 0.181089 Jun 30 12:37:20.017768 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 254/494] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:37:19 2022] GET /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0 => generated 1722 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:37:21.039623 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-4e802e6c-548a-4f0a-b6a2-b0ead84293ba tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:37:21.040573 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-4e802e6c-548a-4f0a-b6a2-b0ead84293ba tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: 7f35d48f-59b1-4105-a9ea-a6ffee1b86d0] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:37:21.051913 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-4e802e6c-548a-4f0a-b6a2-b0ead84293ba tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:21.052833 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-4e802e6c-548a-4f0a-b6a2-b0ead84293ba tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:21.053795 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-4e802e6c-548a-4f0a-b6a2-b0ead84293ba tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:21.054515 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-4e802e6c-548a-4f0a-b6a2-b0ead84293ba tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:21.197908 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-4e802e6c-548a-4f0a-b6a2-b0ead84293ba tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:37:21.206432 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-4e802e6c-548a-4f0a-b6a2-b0ead84293ba tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0" status: 200 len: 1722 microversion: 2.1 time: 0.174129 Jun 30 12:37:21.207003 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 241/495] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:37:21 2022] GET /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:37:22.223416 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-5a14c965-e8c7-466e-ac13-469b72ad816e tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:37:22.224235 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-5a14c965-e8c7-466e-ac13-469b72ad816e tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: 7f35d48f-59b1-4105-a9ea-a6ffee1b86d0] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:37:22.231550 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-5a14c965-e8c7-466e-ac13-469b72ad816e tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:22.231992 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-5a14c965-e8c7-466e-ac13-469b72ad816e tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:22.232800 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-5a14c965-e8c7-466e-ac13-469b72ad816e tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:22.235068 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-5a14c965-e8c7-466e-ac13-469b72ad816e tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:22.387320 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-5a14c965-e8c7-466e-ac13-469b72ad816e tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:37:22.398861 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-5a14c965-e8c7-466e-ac13-469b72ad816e tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0" status: 200 len: 1728 microversion: 2.1 time: 0.179311 Jun 30 12:37:22.399458 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 255/496] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:37:22 2022] GET /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0 => generated 1728 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:37:22.415963 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-c6e4a833-301d-4b02-86fc-91d5c1124b23 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:37:22.416522 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-c6e4a833-301d-4b02-86fc-91d5c1124b23 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: 7f35d48f-59b1-4105-a9ea-a6ffee1b86d0] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:37:22.423526 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-c6e4a833-301d-4b02-86fc-91d5c1124b23 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:22.423967 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-c6e4a833-301d-4b02-86fc-91d5c1124b23 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:22.424757 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-c6e4a833-301d-4b02-86fc-91d5c1124b23 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:22.425190 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-c6e4a833-301d-4b02-86fc-91d5c1124b23 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:22.503386 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-c6e4a833-301d-4b02-86fc-91d5c1124b23 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091641 Jun 30 12:37:22.503976 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 242/497] 10.222.0.57 () {58 vars in 1274 bytes} [Thu Jun 30 12:37:22 2022] GET /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:37:23.472180 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [req-3efa1daf-4dda-445c-a4da-3b28766e7029 req-cb8543ec-8252-41f3-91d1-75a63771b3f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f35d48f-59b1-4105-a9ea-a6ffee1b86d0", "tag": "429c2df1-f159-4a74-afc7-610947f53fa7"}]} {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:37:23.481891 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [req-3efa1daf-4dda-445c-a4da-3b28766e7029 req-cb8543ec-8252-41f3-91d1-75a63771b3f9 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:23.482513 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [req-3efa1daf-4dda-445c-a4da-3b28766e7029 req-cb8543ec-8252-41f3-91d1-75a63771b3f9 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:23.495198 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.compute.server_external_events [req-3efa1daf-4dda-445c-a4da-3b28766e7029 req-cb8543ec-8252-41f3-91d1-75a63771b3f9 service nova] Creating event network-changed:429c2df1-f159-4a74-afc7-610947f53fa7 for instance 7f35d48f-59b1-4105-a9ea-a6ffee1b86d0 on hv-cinder-84614 Jun 30 12:37:23.501008 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [req-3efa1daf-4dda-445c-a4da-3b28766e7029 req-cb8543ec-8252-41f3-91d1-75a63771b3f9 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032518 Jun 30 12:37:23.502046 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 256/498] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 30 12:37:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:37:25.515822 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [req-23d9dfc7-ece3-4ed6-b10b-3d9ffdffb2cd req-9ab216ce-3017-4201-8376-fcd5673a1c3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f35d48f-59b1-4105-a9ea-a6ffee1b86d0", "tag": "429c2df1-f159-4a74-afc7-610947f53fa7"}]} {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:37:25.525983 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [req-23d9dfc7-ece3-4ed6-b10b-3d9ffdffb2cd req-9ab216ce-3017-4201-8376-fcd5673a1c3e service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:25.526418 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [req-23d9dfc7-ece3-4ed6-b10b-3d9ffdffb2cd req-9ab216ce-3017-4201-8376-fcd5673a1c3e service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:25.539170 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.compute.server_external_events [req-23d9dfc7-ece3-4ed6-b10b-3d9ffdffb2cd req-9ab216ce-3017-4201-8376-fcd5673a1c3e service nova] Creating event network-changed:429c2df1-f159-4a74-afc7-610947f53fa7 for instance 7f35d48f-59b1-4105-a9ea-a6ffee1b86d0 on hv-cinder-84614 Jun 30 12:37:25.544408 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [req-23d9dfc7-ece3-4ed6-b10b-3d9ffdffb2cd req-9ab216ce-3017-4201-8376-fcd5673a1c3e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032683 Jun 30 12:37:25.545295 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 243/499] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 30 12:37:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:37:41.853723 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG dbcounter [-] [124297] Writing DB stats nova_api:SELECT=21 {{(pid=124297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:41.854610 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG dbcounter [-] [124297] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:41.859661 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-96b5770f-e83f-40a5-9051-32d2eafd39a9 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:37:41.860249 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-96b5770f-e83f-40a5-9051-32d2eafd39a9 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] [instance: cac81943-11c4-47b1-8bbc-c34b261f8237] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:37:41.868594 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-96b5770f-e83f-40a5-9051-32d2eafd39a9 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:41.869097 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-96b5770f-e83f-40a5-9051-32d2eafd39a9 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:41.869866 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-96b5770f-e83f-40a5-9051-32d2eafd39a9 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:41.870307 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-96b5770f-e83f-40a5-9051-32d2eafd39a9 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:41.955406 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.objects.instance [None req-96b5770f-e83f-40a5-9051-32d2eafd39a9 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lazy-loading 'services' on Instance uuid cac81943-11c4-47b1-8bbc-c34b261f8237 {{(pid=124297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 12:37:42.038862 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-96b5770f-e83f-40a5-9051-32d2eafd39a9 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] 10.222.0.57 "DELETE /compute/v2.1/servers/cac81943-11c4-47b1-8bbc-c34b261f8237/os-volume_attachments/2fa0c886-7bd5-4f10-ac32-591d859ec421" status: 202 len: 0 microversion: 2.1 time: 0.187092 Jun 30 12:37:42.039448 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 257/500] 10.222.0.57 () {58 vars in 1415 bytes} [Thu Jun 30 12:37:41 2022] DELETE /compute/v2.1/servers/cac81943-11c4-47b1-8bbc-c34b261f8237/os-volume_attachments/2fa0c886-7bd5-4f10-ac32-591d859ec421 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 12:37:44.213841 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG dbcounter [-] [124298] Writing DB stats nova_api:SELECT=21 {{(pid=124298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:44.214580 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG dbcounter [-] [124298] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:44.219405 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-206f0a1c-eb8c-4877-8c96-34994aae6e33 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:37:44.219985 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-206f0a1c-eb8c-4877-8c96-34994aae6e33 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] [instance: cac81943-11c4-47b1-8bbc-c34b261f8237] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:37:44.227800 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-206f0a1c-eb8c-4877-8c96-34994aae6e33 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:44.228238 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-206f0a1c-eb8c-4877-8c96-34994aae6e33 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:44.229016 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-206f0a1c-eb8c-4877-8c96-34994aae6e33 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:44.229439 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-206f0a1c-eb8c-4877-8c96-34994aae6e33 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:44.257303 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-206f0a1c-eb8c-4877-8c96-34994aae6e33 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] [instance: cac81943-11c4-47b1-8bbc-c34b261f8237] Going to try to terminate instance {{(pid=124298) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 12:37:44.338149 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-206f0a1c-eb8c-4877-8c96-34994aae6e33 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] 10.222.0.57 "DELETE /compute/v2.1/servers/cac81943-11c4-47b1-8bbc-c34b261f8237" status: 204 len: 0 microversion: 2.1 time: 0.125685 Jun 30 12:37:44.338733 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 244/501] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 30 12:37:44 2022] DELETE /compute/v2.1/servers/cac81943-11c4-47b1-8bbc-c34b261f8237 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 12:37:44.348432 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-87530760-0598-4d67-8ed9-b92c176bd4f3 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:37:44.349200 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-87530760-0598-4d67-8ed9-b92c176bd4f3 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] [instance: cac81943-11c4-47b1-8bbc-c34b261f8237] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:37:44.356475 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-87530760-0598-4d67-8ed9-b92c176bd4f3 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:44.356952 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-87530760-0598-4d67-8ed9-b92c176bd4f3 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:44.357730 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-87530760-0598-4d67-8ed9-b92c176bd4f3 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:44.358159 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-87530760-0598-4d67-8ed9-b92c176bd4f3 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:44.496618 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-87530760-0598-4d67-8ed9-b92c176bd4f3 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdc0eeb6cd443d78aefefca488d8c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3eabfe3692b44d8ae5f7d137ce1d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:37:44.504344 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-87530760-0598-4d67-8ed9-b92c176bd4f3 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] 10.222.0.57 "GET /compute/v2.1/servers/cac81943-11c4-47b1-8bbc-c34b261f8237" status: 200 len: 1513 microversion: 2.1 time: 0.160677 Jun 30 12:37:44.504950 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 258/502] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:37:44 2022] GET /compute/v2.1/servers/cac81943-11c4-47b1-8bbc-c34b261f8237 => generated 1513 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:37:45.532571 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-78acef4f-3f04-42ab-a96a-5c94c733ecc8 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:37:45.533757 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-78acef4f-3f04-42ab-a96a-5c94c733ecc8 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] [instance: cac81943-11c4-47b1-8bbc-c34b261f8237] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:37:45.545189 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-78acef4f-3f04-42ab-a96a-5c94c733ecc8 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:45.545638 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-78acef4f-3f04-42ab-a96a-5c94c733ecc8 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:45.546408 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-78acef4f-3f04-42ab-a96a-5c94c733ecc8 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:45.546841 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-78acef4f-3f04-42ab-a96a-5c94c733ecc8 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:45.690009 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-78acef4f-3f04-42ab-a96a-5c94c733ecc8 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdc0eeb6cd443d78aefefca488d8c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3eabfe3692b44d8ae5f7d137ce1d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:37:45.698170 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-78acef4f-3f04-42ab-a96a-5c94c733ecc8 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] 10.222.0.57 "GET /compute/v2.1/servers/cac81943-11c4-47b1-8bbc-c34b261f8237" status: 200 len: 1513 microversion: 2.1 time: 0.172942 Jun 30 12:37:45.698748 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 245/503] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:37:45 2022] GET /compute/v2.1/servers/cac81943-11c4-47b1-8bbc-c34b261f8237 => generated 1513 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:37:46.715526 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-cf28f9cb-4543-43f6-9edd-02ccb9dc0084 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:37:46.716097 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-cf28f9cb-4543-43f6-9edd-02ccb9dc0084 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] [instance: cac81943-11c4-47b1-8bbc-c34b261f8237] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:37:46.723633 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-cf28f9cb-4543-43f6-9edd-02ccb9dc0084 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:46.724077 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-cf28f9cb-4543-43f6-9edd-02ccb9dc0084 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:46.724874 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-cf28f9cb-4543-43f6-9edd-02ccb9dc0084 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:46.725302 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-cf28f9cb-4543-43f6-9edd-02ccb9dc0084 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:46.862881 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-cf28f9cb-4543-43f6-9edd-02ccb9dc0084 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdc0eeb6cd443d78aefefca488d8c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3eabfe3692b44d8ae5f7d137ce1d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:37:46.870428 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-cf28f9cb-4543-43f6-9edd-02ccb9dc0084 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] 10.222.0.57 "GET /compute/v2.1/servers/cac81943-11c4-47b1-8bbc-c34b261f8237" status: 200 len: 1513 microversion: 2.1 time: 0.158849 Jun 30 12:37:46.870997 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 259/504] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:37:46 2022] GET /compute/v2.1/servers/cac81943-11c4-47b1-8bbc-c34b261f8237 => generated 1513 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:37:46.944204 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [req-2b078a13-3d1c-4e5b-92db-ee24aa63971c req-d18ece42-3794-40a5-9142-2ee8d8cdcb1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cac81943-11c4-47b1-8bbc-c34b261f8237", "name": "network-vif-deleted", "tag": "e06fcd1b-c6e5-430f-aec7-1c5386fcf5e5"}]} {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:37:46.954965 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [req-2b078a13-3d1c-4e5b-92db-ee24aa63971c req-d18ece42-3794-40a5-9142-2ee8d8cdcb1e service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:46.955402 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [req-2b078a13-3d1c-4e5b-92db-ee24aa63971c req-d18ece42-3794-40a5-9142-2ee8d8cdcb1e service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:46.968902 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.compute.server_external_events [req-2b078a13-3d1c-4e5b-92db-ee24aa63971c req-d18ece42-3794-40a5-9142-2ee8d8cdcb1e service nova] Creating event network-vif-deleted:e06fcd1b-c6e5-430f-aec7-1c5386fcf5e5 for instance cac81943-11c4-47b1-8bbc-c34b261f8237 on hv-cinder-84614 Jun 30 12:37:46.973955 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [req-2b078a13-3d1c-4e5b-92db-ee24aa63971c req-d18ece42-3794-40a5-9142-2ee8d8cdcb1e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033500 Jun 30 12:37:46.974803 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 246/505] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 30 12:37:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:37:47.891646 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-749125e3-aaab-4d50-bc20-7dea152996a7 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:37:47.892212 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-749125e3-aaab-4d50-bc20-7dea152996a7 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] [instance: cac81943-11c4-47b1-8bbc-c34b261f8237] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:37:47.899038 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-749125e3-aaab-4d50-bc20-7dea152996a7 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:47.899482 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-749125e3-aaab-4d50-bc20-7dea152996a7 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:47.900236 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-749125e3-aaab-4d50-bc20-7dea152996a7 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:47.900668 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-749125e3-aaab-4d50-bc20-7dea152996a7 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:47.916862 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.wsgi [None req-749125e3-aaab-4d50-bc20-7dea152996a7 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] HTTP exception thrown: Instance cac81943-11c4-47b1-8bbc-c34b261f8237 could not be found. Jun 30 12:37:47.918470 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-749125e3-aaab-4d50-bc20-7dea152996a7 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Request method failure captured: Jun 30 12:37:47.918470 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: request: GET /compute/v2.1/servers/cac81943-11c4-47b1-8bbc-c34b261f8237 HTTP/1.1 Jun 30 12:37:47.918470 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Accept: application/json Jun 30 12:37:47.918470 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Accept-Encoding: identity Jun 30 12:37:47.918470 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Connection: close Jun 30 12:37:47.918470 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Content-Length: 0 Jun 30 12:37:47.918470 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Content-Type: application/json Jun 30 12:37:47.918470 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Host: 10.222.0.57 Jun 30 12:37:47.918470 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Openstack-System-Scope: None Jun 30 12:37:47.918470 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: User-Agent: python-urllib3/1.26.9 Jun 30 12:37:47.918470 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Auth-Token: gAAAAABivZjWjLASIkgEAJVFiE1fOQTNLbsj7988LOtStRRtLtUsDo-YsdIJQkOq4GkobxKS7GtZElIil-0_YOs5BM2ZaXISf6ZrMcRGvYPCCRLWN0v9kEkCT6WQuciWD9eTTJg_u-mm-Cn9odatXePB6wJfaF2pAR1_cW2tOieOxWoCsTKWgiM Jun 30 12:37:47.918470 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Domain-Id: None Jun 30 12:37:47.918470 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Domain-Name: None Jun 30 12:37:47.918470 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Identity-Status: Confirmed Jun 30 12:37:47.918470 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Is-Admin-Project: True Jun 30 12:37:47.918470 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Project-Domain-Id: default Jun 30 12:37:47.918470 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Project-Domain-Name: Default Jun 30 12:37:47.918470 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Project-Id: e3eabfe3692b44d8ae5f7d137ce1d157 Jun 30 12:37:47.918470 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Project-Name: tempest-VolumesSnapshotTestJSON-294987499 Jun 30 12:37:47.918470 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Role: member,reader Jun 30 12:37:47.918470 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Roles: member,reader Jun 30 12:37:47.919913 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/e3eabfe3692b44d8ae5f7d137ce1d157"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e3eabfe3692b44d8ae5f7d137ce1d157"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_e3eabfe3692b44d8ae5f7d137ce1d157", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e3eabfe3692b44d8ae5f7d137ce1d157"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 30 12:37:47.919913 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Tenant: tempest-VolumesSnapshotTestJSON-294987499 Jun 30 12:37:47.919913 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Tenant-Id: e3eabfe3692b44d8ae5f7d137ce1d157 Jun 30 12:37:47.919913 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-294987499 Jun 30 12:37:47.919913 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User: tempest-VolumesSnapshotTestJSON-294987499-project Jun 30 12:37:47.919913 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User-Domain-Id: default Jun 30 12:37:47.919913 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User-Domain-Name: Default Jun 30 12:37:47.919913 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User-Id: 4bdc0eeb6cd443d78aefefca488d8c5d Jun 30 12:37:47.919913 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User-Name: tempest-VolumesSnapshotTestJSON-294987499-project Jun 30 12:37:47.919913 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: method: > Jun 30 12:37:47.919913 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: exception: Instance cac81943-11c4-47b1-8bbc-c34b261f8237 could not be found. Jun 30 12:37:47.919913 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: action_args: {'id': 'cac81943-11c4-47b1-8bbc-c34b261f8237'} Jun 30 12:37:47.920758 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 12:37:47.920758 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:37:47.920758 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 12:37:47.920758 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 12:37:47.920758 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 12:37:47.920758 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 12:37:47.920758 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 12:37:47.920758 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 12:37:47.920758 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 12:37:47.920758 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 12:37:47.920758 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cac81943-11c4-47b1-8bbc-c34b261f8237 could not be found. Jun 30 12:37:47.920758 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:37:47.920758 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:37:47.920758 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:37:47.920758 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:37:47.920758 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:37:47.920758 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:37:47.920758 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 12:37:47.920758 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 12:37:47.920758 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 12:37:47.922568 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 12:37:47.922568 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 12:37:47.922568 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 12:37:47.922568 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 12:37:47.922568 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 12:37:47.922568 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 12:37:47.922568 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 12:37:47.922568 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cac81943-11c4-47b1-8bbc-c34b261f8237 could not be found. Jun 30 12:37:47.922568 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:37:47.922568 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:37:47.922568 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:37:47.922568 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:37:47.922568 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:37:47.922568 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:37:47.922568 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 12:37:47.922568 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 12:37:47.922568 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cac81943-11c4-47b1-8bbc-c34b261f8237 could not be found. Jun 30 12:37:47.922568 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:37:47.924184 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-749125e3-aaab-4d50-bc20-7dea152996a7 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Returning 404 to user: Instance cac81943-11c4-47b1-8bbc-c34b261f8237 could not be found. {{(pid=124297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 12:37:47.924184 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-749125e3-aaab-4d50-bc20-7dea152996a7 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] 10.222.0.57 "GET /compute/v2.1/servers/cac81943-11c4-47b1-8bbc-c34b261f8237" status: 404 len: 111 microversion: 2.1 time: 0.034437 Jun 30 12:37:47.924184 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 260/506] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:37:47 2022] GET /compute/v2.1/servers/cac81943-11c4-47b1-8bbc-c34b261f8237 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 12:37:52.605572 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-cc9f5395-84b7-4e63-a381-9dfc81b7f305 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2030518833"}} {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:37:52.606200 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-cc9f5395-84b7-4e63-a381-9dfc81b7f305 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] [instance: d328d6c1-d49a-48c5-a26e-1ab70019f6df] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:37:52.616161 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-cc9f5395-84b7-4e63-a381-9dfc81b7f305 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:52.616823 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-cc9f5395-84b7-4e63-a381-9dfc81b7f305 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:52.617918 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-cc9f5395-84b7-4e63-a381-9dfc81b7f305 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:52.618532 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-cc9f5395-84b7-4e63-a381-9dfc81b7f305 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:52.894393 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.network.security_group_api [None req-cc9f5395-84b7-4e63-a381-9dfc81b7f305 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Removing security group 41c3fba9-c949-4730-bb0f-0d42e92706c7 from port a04c1ee8-5a15-46b6-87ec-288a776bc842 Jun 30 12:37:53.253369 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-cc9f5395-84b7-4e63-a381-9dfc81b7f305 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] 10.222.0.57 "POST /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df/action" status: 202 len: 0 microversion: 2.1 time: 0.651984 Jun 30 12:37:53.254186 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 247/507] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Jun 30 12:37:52 2022] POST /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df/action => generated 0 bytes in 654 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 12:37:53.262161 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [req-39679aec-6a79-40ed-8b65-430d0b6d8c8f req-ff89b880-1e3a-4d75-8485-9c34915bf285 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d328d6c1-d49a-48c5-a26e-1ab70019f6df", "tag": "a04c1ee8-5a15-46b6-87ec-288a776bc842"}]} {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:37:53.273085 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [req-39679aec-6a79-40ed-8b65-430d0b6d8c8f req-ff89b880-1e3a-4d75-8485-9c34915bf285 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:53.273533 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [req-39679aec-6a79-40ed-8b65-430d0b6d8c8f req-ff89b880-1e3a-4d75-8485-9c34915bf285 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:53.294452 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.compute.server_external_events [req-39679aec-6a79-40ed-8b65-430d0b6d8c8f req-ff89b880-1e3a-4d75-8485-9c34915bf285 service nova] Creating event network-changed:a04c1ee8-5a15-46b6-87ec-288a776bc842 for instance d328d6c1-d49a-48c5-a26e-1ab70019f6df on hv-cinder-84614 Jun 30 12:37:53.300324 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [req-39679aec-6a79-40ed-8b65-430d0b6d8c8f req-ff89b880-1e3a-4d75-8485-9c34915bf285 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042581 Jun 30 12:37:53.301217 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 261/508] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 30 12:37:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:37:54.595925 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-57ef02e7-6cb1-4ab5-8672-e94813375e33 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:37:54.596489 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-57ef02e7-6cb1-4ab5-8672-e94813375e33 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] [instance: d328d6c1-d49a-48c5-a26e-1ab70019f6df] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:37:54.602622 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-57ef02e7-6cb1-4ab5-8672-e94813375e33 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:54.603060 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-57ef02e7-6cb1-4ab5-8672-e94813375e33 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:54.603825 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-57ef02e7-6cb1-4ab5-8672-e94813375e33 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:54.604261 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-57ef02e7-6cb1-4ab5-8672-e94813375e33 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:54.685444 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.objects.instance [None req-57ef02e7-6cb1-4ab5-8672-e94813375e33 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lazy-loading 'services' on Instance uuid d328d6c1-d49a-48c5-a26e-1ab70019f6df {{(pid=124298) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 12:37:54.807615 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-57ef02e7-6cb1-4ab5-8672-e94813375e33 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] 10.222.0.57 "DELETE /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df/os-volume_attachments/63005eb7-5c0f-4539-a9a8-78ff577cf415" status: 202 len: 0 microversion: 2.1 time: 0.216199 Jun 30 12:37:54.808332 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 248/509] 10.222.0.57 () {58 vars in 1415 bytes} [Thu Jun 30 12:37:54 2022] DELETE /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df/os-volume_attachments/63005eb7-5c0f-4539-a9a8-78ff577cf415 => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 12:37:54.818512 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-bad1534e-68e8-465b-b53e-487c9302c62f tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:37:54.819717 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-bad1534e-68e8-465b-b53e-487c9302c62f tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] [instance: d328d6c1-d49a-48c5-a26e-1ab70019f6df] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:37:54.826460 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-bad1534e-68e8-465b-b53e-487c9302c62f tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:54.826995 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-bad1534e-68e8-465b-b53e-487c9302c62f tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:54.827934 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-bad1534e-68e8-465b-b53e-487c9302c62f tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:54.828877 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-bad1534e-68e8-465b-b53e-487c9302c62f tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:54.858069 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-bad1534e-68e8-465b-b53e-487c9302c62f tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] 10.222.0.57 "GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044770 Jun 30 12:37:54.858776 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 262/510] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jun 30 12:37:54 2022] GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:37:55.315984 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [req-a2198671-f40b-493d-a48e-dd7443220f38 req-1898fec1-5779-4f1b-9d4d-ef264b4859c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d328d6c1-d49a-48c5-a26e-1ab70019f6df", "tag": "a04c1ee8-5a15-46b6-87ec-288a776bc842"}]} {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:37:55.325246 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [req-a2198671-f40b-493d-a48e-dd7443220f38 req-1898fec1-5779-4f1b-9d4d-ef264b4859c0 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:55.325725 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [req-a2198671-f40b-493d-a48e-dd7443220f38 req-1898fec1-5779-4f1b-9d4d-ef264b4859c0 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:55.337887 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.compute.server_external_events [req-a2198671-f40b-493d-a48e-dd7443220f38 req-1898fec1-5779-4f1b-9d4d-ef264b4859c0 service nova] Creating event network-changed:a04c1ee8-5a15-46b6-87ec-288a776bc842 for instance d328d6c1-d49a-48c5-a26e-1ab70019f6df on hv-cinder-84614 Jun 30 12:37:55.343034 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [req-a2198671-f40b-493d-a48e-dd7443220f38 req-1898fec1-5779-4f1b-9d4d-ef264b4859c0 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031157 Jun 30 12:37:55.343636 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 249/511] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 30 12:37:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:37:55.655804 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-ac1ed90b-0eb6-4434-af52-c0ff4604ab1b tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:37:55.657267 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-ac1ed90b-0eb6-4434-af52-c0ff4604ab1b tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 99ba3b96-6700-41e0-b2cf-ff8933b2bf94] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:37:55.664727 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-ac1ed90b-0eb6-4434-af52-c0ff4604ab1b tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:55.665744 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-ac1ed90b-0eb6-4434-af52-c0ff4604ab1b tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:55.666704 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-ac1ed90b-0eb6-4434-af52-c0ff4604ab1b tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:55.667129 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-ac1ed90b-0eb6-4434-af52-c0ff4604ab1b tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:55.706474 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-ac1ed90b-0eb6-4434-af52-c0ff4604ab1b tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057987 Jun 30 12:37:55.707464 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 263/512] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jun 30 12:37:55 2022] GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 30 12:37:55.771275 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-86d3f044-4569-4eae-ae3d-3bf175e7b50d tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:37:55.771798 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-86d3f044-4569-4eae-ae3d-3bf175e7b50d tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 99ba3b96-6700-41e0-b2cf-ff8933b2bf94] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:37:55.778033 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-86d3f044-4569-4eae-ae3d-3bf175e7b50d tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:55.778483 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-86d3f044-4569-4eae-ae3d-3bf175e7b50d tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:55.779253 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-86d3f044-4569-4eae-ae3d-3bf175e7b50d tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:55.779688 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-86d3f044-4569-4eae-ae3d-3bf175e7b50d tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:55.782113 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-65f8eeba-2de1-4deb-81f0-e016a37a75e0 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-461319814", "imageRef": "776a1662-a241-4e20-9a9c-e4743c64efd0", "flavorRef": "452", "networks": [{"uuid": "8db768bb-11e9-4127-8aac-ea023e37020c"}]}} {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:37:55.810553 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-86d3f044-4569-4eae-ae3d-3bf175e7b50d tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 99ba3b96-6700-41e0-b2cf-ff8933b2bf94] Going to try to terminate instance {{(pid=124298) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 12:37:55.893723 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-86d3f044-4569-4eae-ae3d-3bf175e7b50d tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "DELETE /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94" status: 204 len: 0 microversion: 2.1 time: 0.127326 Jun 30 12:37:55.897611 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 250/513] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 30 12:37:55 2022] DELETE /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 12:37:55.900273 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-f35683a1-0a65-4707-a3e6-bcfbb915cc3c tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:37:55.901344 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-f35683a1-0a65-4707-a3e6-bcfbb915cc3c tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] [instance: d328d6c1-d49a-48c5-a26e-1ab70019f6df] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:37:55.907560 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-f35683a1-0a65-4707-a3e6-bcfbb915cc3c tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:55.907888 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-f35683a1-0a65-4707-a3e6-bcfbb915cc3c tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:55.908672 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-f35683a1-0a65-4707-a3e6-bcfbb915cc3c tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:55.909107 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-f35683a1-0a65-4707-a3e6-bcfbb915cc3c tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:55.949238 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-f35683a1-0a65-4707-a3e6-bcfbb915cc3c tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] 10.222.0.57 "GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053396 Jun 30 12:37:55.949800 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 251/514] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jun 30 12:37:55 2022] GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:37:55.954502 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-c89b0bc7-f0ab-4e58-a7bb-afc827399dd2 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:37:55.955111 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-c89b0bc7-f0ab-4e58-a7bb-afc827399dd2 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 99ba3b96-6700-41e0-b2cf-ff8933b2bf94] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:37:55.961421 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-c89b0bc7-f0ab-4e58-a7bb-afc827399dd2 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:55.961967 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-c89b0bc7-f0ab-4e58-a7bb-afc827399dd2 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:55.963232 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-c89b0bc7-f0ab-4e58-a7bb-afc827399dd2 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:55.963232 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-c89b0bc7-f0ab-4e58-a7bb-afc827399dd2 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:55.974066 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.network.neutron [None req-65f8eeba-2de1-4deb-81f0-e016a37a75e0 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] validate_networks() for [('8db768bb-11e9-4127-8aac-ea023e37020c', None, None, None, None, None)] {{(pid=124297) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 12:37:56.188075 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-c89b0bc7-f0ab-4e58-a7bb-afc827399dd2 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddb38b4d6864a6c96b84c9a4092eea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60d10dba1d947cc97149a063a810129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:37:56.196152 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-c89b0bc7-f0ab-4e58-a7bb-afc827399dd2 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94" status: 200 len: 1672 microversion: 2.1 time: 0.245353 Jun 30 12:37:56.197193 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 252/515] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:37:55 2022] GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94 => generated 1672 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:37:56.418166 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.virt.hardware [None req-65f8eeba-2de1-4deb-81f0-e016a37a75e0 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Flavor limits 0:0:0 {{(pid=124297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 12:37:56.418592 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.virt.hardware [None req-65f8eeba-2de1-4deb-81f0-e016a37a75e0 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Image limits 0:0:0 {{(pid=124297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 12:37:56.419062 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.virt.hardware [None req-65f8eeba-2de1-4deb-81f0-e016a37a75e0 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Flavor pref 0:0:0 {{(pid=124297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 12:37:56.419472 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.virt.hardware [None req-65f8eeba-2de1-4deb-81f0-e016a37a75e0 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Image pref 0:0:0 {{(pid=124297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 12:37:56.419882 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.virt.hardware [None req-65f8eeba-2de1-4deb-81f0-e016a37a75e0 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 12:37:56.429834 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-65f8eeba-2de1-4deb-81f0-e016a37a75e0 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:56.430255 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-65f8eeba-2de1-4deb-81f0-e016a37a75e0 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:56.431065 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-65f8eeba-2de1-4deb-81f0-e016a37a75e0 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:56.431501 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-65f8eeba-2de1-4deb-81f0-e016a37a75e0 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:56.449430 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.quota [None req-65f8eeba-2de1-4deb-81f0-e016a37a75e0 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Getting quotas for project e3eabfe3692b44d8ae5f7d137ce1d157. Resources: {'cores', 'ram', 'instances'} {{(pid=124297) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 12:37:56.453933 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.quota [None req-65f8eeba-2de1-4deb-81f0-e016a37a75e0 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Getting quotas for user 4bdc0eeb6cd443d78aefefca488d8c5d and project e3eabfe3692b44d8ae5f7d137ce1d157. Resources: {'cores', 'ram', 'instances'} {{(pid=124297) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 12:37:56.466354 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-65f8eeba-2de1-4deb-81f0-e016a37a75e0 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Going to run 1 instances... {{(pid=124297) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 12:37:56.468673 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-65f8eeba-2de1-4deb-81f0-e016a37a75e0 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] [instance: 7d480b17-8874-4183-a7ec-3eed3d6bbb1b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='776a1662-a241-4e20-9a9c-e4743c64efd0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124297) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 12:37:56.516823 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-65f8eeba-2de1-4deb-81f0-e016a37a75e0 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.738546 Jun 30 12:37:56.517473 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 264/516] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 30 12:37:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 740 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 30 12:37:56.527708 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-3ca70910-6ee8-48b6-9db2-5c1ab1979753 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:37:56.528316 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-3ca70910-6ee8-48b6-9db2-5c1ab1979753 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] [instance: 7d480b17-8874-4183-a7ec-3eed3d6bbb1b] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:37:56.593670 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-3ca70910-6ee8-48b6-9db2-5c1ab1979753 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdc0eeb6cd443d78aefefca488d8c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3eabfe3692b44d8ae5f7d137ce1d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:37:56.601991 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-3ca70910-6ee8-48b6-9db2-5c1ab1979753 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] 10.222.0.57 "GET /compute/v2.1/servers/7d480b17-8874-4183-a7ec-3eed3d6bbb1b" status: 200 len: 1218 microversion: 2.1 time: 0.078142 Jun 30 12:37:56.602956 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 253/517] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:37:56 2022] GET /compute/v2.1/servers/7d480b17-8874-4183-a7ec-3eed3d6bbb1b => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:37:56.962150 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-1a7f697e-6003-492d-ba1a-0b7b95cd860c tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:37:56.963173 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-1a7f697e-6003-492d-ba1a-0b7b95cd860c tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] [instance: d328d6c1-d49a-48c5-a26e-1ab70019f6df] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:37:56.971138 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-1a7f697e-6003-492d-ba1a-0b7b95cd860c tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:56.971581 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-1a7f697e-6003-492d-ba1a-0b7b95cd860c tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:56.972479 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-1a7f697e-6003-492d-ba1a-0b7b95cd860c tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:56.972960 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-1a7f697e-6003-492d-ba1a-0b7b95cd860c tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:57.003346 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-1a7f697e-6003-492d-ba1a-0b7b95cd860c tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] 10.222.0.57 "GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046094 Jun 30 12:37:57.003962 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 265/518] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jun 30 12:37:56 2022] GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:37:57.213705 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-694e0de6-4030-438c-93a3-7e3f5b09729b tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:37:57.214280 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-694e0de6-4030-438c-93a3-7e3f5b09729b tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 99ba3b96-6700-41e0-b2cf-ff8933b2bf94] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:37:57.221409 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-694e0de6-4030-438c-93a3-7e3f5b09729b tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:57.221852 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-694e0de6-4030-438c-93a3-7e3f5b09729b tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:57.222606 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-694e0de6-4030-438c-93a3-7e3f5b09729b tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:57.223033 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-694e0de6-4030-438c-93a3-7e3f5b09729b tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:57.371827 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-694e0de6-4030-438c-93a3-7e3f5b09729b tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddb38b4d6864a6c96b84c9a4092eea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60d10dba1d947cc97149a063a810129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:37:57.379948 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-694e0de6-4030-438c-93a3-7e3f5b09729b tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94" status: 200 len: 1672 microversion: 2.1 time: 0.170062 Jun 30 12:37:57.380524 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 254/519] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:37:57 2022] GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94 => generated 1672 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:37:57.625772 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-7d3fb8f1-751a-44a9-8a48-a61c2051728b tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:37:57.626528 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-7d3fb8f1-751a-44a9-8a48-a61c2051728b tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] [instance: 7d480b17-8874-4183-a7ec-3eed3d6bbb1b] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:37:57.634019 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-7d3fb8f1-751a-44a9-8a48-a61c2051728b tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:57.634539 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-7d3fb8f1-751a-44a9-8a48-a61c2051728b tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:57.635432 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-7d3fb8f1-751a-44a9-8a48-a61c2051728b tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:57.635936 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-7d3fb8f1-751a-44a9-8a48-a61c2051728b tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:57.707150 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-7d3fb8f1-751a-44a9-8a48-a61c2051728b tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdc0eeb6cd443d78aefefca488d8c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3eabfe3692b44d8ae5f7d137ce1d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:37:57.714760 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-7d3fb8f1-751a-44a9-8a48-a61c2051728b tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] 10.222.0.57 "GET /compute/v2.1/servers/7d480b17-8874-4183-a7ec-3eed3d6bbb1b" status: 200 len: 1222 microversion: 2.1 time: 0.095905 Jun 30 12:37:57.715320 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 266/520] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:37:57 2022] GET /compute/v2.1/servers/7d480b17-8874-4183-a7ec-3eed3d6bbb1b => generated 1222 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:37:58.015797 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-8c3b0de1-50d0-4fba-aed8-f07e0bf0e90a tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:37:58.017100 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-8c3b0de1-50d0-4fba-aed8-f07e0bf0e90a tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] [instance: d328d6c1-d49a-48c5-a26e-1ab70019f6df] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:37:58.023703 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-8c3b0de1-50d0-4fba-aed8-f07e0bf0e90a tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:58.024153 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-8c3b0de1-50d0-4fba-aed8-f07e0bf0e90a tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:58.024947 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-8c3b0de1-50d0-4fba-aed8-f07e0bf0e90a tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:58.025388 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-8c3b0de1-50d0-4fba-aed8-f07e0bf0e90a tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:58.053553 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 12:37:58.053982 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Thu Jun 30 12:37:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 12:37:58.058810 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-8c3b0de1-50d0-4fba-aed8-f07e0bf0e90a tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] 10.222.0.57 "GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047075 Jun 30 12:37:58.062761 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 255/521] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jun 30 12:37:58 2022] GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:37:58.526964 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-bdbca5d8-0f47-4dbd-8283-ed60be3bfc5c tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:37:58.527572 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-bdbca5d8-0f47-4dbd-8283-ed60be3bfc5c tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 99ba3b96-6700-41e0-b2cf-ff8933b2bf94] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:37:58.534107 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-bdbca5d8-0f47-4dbd-8283-ed60be3bfc5c tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:58.534402 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-bdbca5d8-0f47-4dbd-8283-ed60be3bfc5c tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:58.535171 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-bdbca5d8-0f47-4dbd-8283-ed60be3bfc5c tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:58.535605 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-bdbca5d8-0f47-4dbd-8283-ed60be3bfc5c tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:58.678554 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-bdbca5d8-0f47-4dbd-8283-ed60be3bfc5c tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddb38b4d6864a6c96b84c9a4092eea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60d10dba1d947cc97149a063a810129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:37:58.686614 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-bdbca5d8-0f47-4dbd-8283-ed60be3bfc5c tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94" status: 200 len: 1672 microversion: 2.1 time: 0.292917 Jun 30 12:37:58.687584 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 267/522] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:37:58 2022] GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94 => generated 1672 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:37:58.731794 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-8cc60ac2-5202-43bc-a25d-25644a142462 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:37:58.732433 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-8cc60ac2-5202-43bc-a25d-25644a142462 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] [instance: 7d480b17-8874-4183-a7ec-3eed3d6bbb1b] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:37:58.739931 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-8cc60ac2-5202-43bc-a25d-25644a142462 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:58.740382 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-8cc60ac2-5202-43bc-a25d-25644a142462 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:58.741465 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-8cc60ac2-5202-43bc-a25d-25644a142462 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:58.742059 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-8cc60ac2-5202-43bc-a25d-25644a142462 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:58.860267 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-8cc60ac2-5202-43bc-a25d-25644a142462 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdc0eeb6cd443d78aefefca488d8c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3eabfe3692b44d8ae5f7d137ce1d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:37:58.869200 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-8cc60ac2-5202-43bc-a25d-25644a142462 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] 10.222.0.57 "GET /compute/v2.1/servers/7d480b17-8874-4183-a7ec-3eed3d6bbb1b" status: 200 len: 1278 microversion: 2.1 time: 0.141357 Jun 30 12:37:58.870474 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 256/523] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:37:58 2022] GET /compute/v2.1/servers/7d480b17-8874-4183-a7ec-3eed3d6bbb1b => generated 1278 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:37:59.072152 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-29bf5eac-10cf-49e1-83e9-4bc7de890ade tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:37:59.073684 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-29bf5eac-10cf-49e1-83e9-4bc7de890ade tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] [instance: d328d6c1-d49a-48c5-a26e-1ab70019f6df] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:37:59.081689 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-29bf5eac-10cf-49e1-83e9-4bc7de890ade tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:59.082129 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-29bf5eac-10cf-49e1-83e9-4bc7de890ade tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:59.082934 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-29bf5eac-10cf-49e1-83e9-4bc7de890ade tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:59.083357 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-29bf5eac-10cf-49e1-83e9-4bc7de890ade tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:59.114964 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-29bf5eac-10cf-49e1-83e9-4bc7de890ade tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] 10.222.0.57 "GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047605 Jun 30 12:37:59.115552 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 268/524] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jun 30 12:37:59 2022] GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 30 12:37:59.126989 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-0548f3f7-24f3-4dcc-ae56-d1beb3c4fb10 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:37:59.127751 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-0548f3f7-24f3-4dcc-ae56-d1beb3c4fb10 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] [instance: d328d6c1-d49a-48c5-a26e-1ab70019f6df] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:37:59.152785 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-0548f3f7-24f3-4dcc-ae56-d1beb3c4fb10 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:59.153592 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-0548f3f7-24f3-4dcc-ae56-d1beb3c4fb10 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:59.154615 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-0548f3f7-24f3-4dcc-ae56-d1beb3c4fb10 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:59.155965 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-0548f3f7-24f3-4dcc-ae56-d1beb3c4fb10 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:59.248039 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.wsgi [None req-0548f3f7-24f3-4dcc-ae56-d1beb3c4fb10 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] HTTP exception thrown: Instance d328d6c1-d49a-48c5-a26e-1ab70019f6df is not attached to volume 63005eb7-5c0f-4539-a9a8-78ff577cf415 Jun 30 12:37:59.251471 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-0548f3f7-24f3-4dcc-ae56-d1beb3c4fb10 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Request method failure captured: Jun 30 12:37:59.251471 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: request: DELETE /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df/os-volume_attachments/63005eb7-5c0f-4539-a9a8-78ff577cf415 HTTP/1.1 Jun 30 12:37:59.251471 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Accept: application/json Jun 30 12:37:59.251471 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Accept-Encoding: identity Jun 30 12:37:59.251471 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Connection: close Jun 30 12:37:59.251471 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Content-Length: 0 Jun 30 12:37:59.251471 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Content-Type: application/json Jun 30 12:37:59.251471 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Host: 10.222.0.57 Jun 30 12:37:59.251471 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Openstack-System-Scope: None Jun 30 12:37:59.251471 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: User-Agent: python-urllib3/1.26.9 Jun 30 12:37:59.251471 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Auth-Token: gAAAAABivZheQJ0SiTVTyN-_2sc5xGyHlrWZFWYITtQ54LkMEBU-fJS-BKUmxnOCLvEhm_El1iY3arGkvaCuDznKPZp18g1Za7FVkmt7729uUnbI7k-PreJasMSwfVkcG4kL6mWUe3J9PKgOMBPP-z-I8mESaEyiO5Dub-2zsX43jBWFTJQ1pE8 Jun 30 12:37:59.251471 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Domain-Id: None Jun 30 12:37:59.251471 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Domain-Name: None Jun 30 12:37:59.251471 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Identity-Status: Confirmed Jun 30 12:37:59.251471 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Is-Admin-Project: True Jun 30 12:37:59.251471 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Domain-Id: default Jun 30 12:37:59.251471 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Domain-Name: Default Jun 30 12:37:59.251471 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Id: 4a42d5073b0f4e4c857d794aa8d30393 Jun 30 12:37:59.251471 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Name: tempest-TestMinimumBasicScenario-181108139 Jun 30 12:37:59.251471 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Role: member,reader Jun 30 12:37:59.251471 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Roles: member,reader Jun 30 12:37:59.254042 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/4a42d5073b0f4e4c857d794aa8d30393"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4a42d5073b0f4e4c857d794aa8d30393"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_4a42d5073b0f4e4c857d794aa8d30393", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4a42d5073b0f4e4c857d794aa8d30393"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 30 12:37:59.254042 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant: tempest-TestMinimumBasicScenario-181108139 Jun 30 12:37:59.254042 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant-Id: 4a42d5073b0f4e4c857d794aa8d30393 Jun 30 12:37:59.254042 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant-Name: tempest-TestMinimumBasicScenario-181108139 Jun 30 12:37:59.254042 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User: tempest-TestMinimumBasicScenario-181108139-project Jun 30 12:37:59.254042 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Domain-Id: default Jun 30 12:37:59.254042 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Domain-Name: Default Jun 30 12:37:59.254042 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Id: 1fc65fea19f94fd18d83ad8ce3bbb476 Jun 30 12:37:59.254042 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Name: tempest-TestMinimumBasicScenario-181108139-project Jun 30 12:37:59.254042 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: method: > Jun 30 12:37:59.254042 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: exception: Instance d328d6c1-d49a-48c5-a26e-1ab70019f6df is not attached to volume 63005eb7-5c0f-4539-a9a8-78ff577cf415 Jun 30 12:37:59.254756 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: action_args: {'server_id': 'd328d6c1-d49a-48c5-a26e-1ab70019f6df', 'id': '63005eb7-5c0f-4539-a9a8-78ff577cf415'} Jun 30 12:37:59.254756 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 12:37:59.254756 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:37:59.254756 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 30 12:37:59.254756 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 30 12:37:59.254756 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 30 12:37:59.254756 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 30 12:37:59.254756 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 30 12:37:59.254756 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 30 12:37:59.254756 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 63005eb7-5c0f-4539-a9a8-78ff577cf415. Jun 30 12:37:59.254756 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:37:59.254756 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:37:59.254756 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:37:59.254756 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:37:59.254756 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:37:59.254756 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:37:59.254756 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 12:37:59.254756 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 12:37:59.254756 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 12:37:59.256045 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 12:37:59.256045 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 30 12:37:59.256045 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 30 12:37:59.256045 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d328d6c1-d49a-48c5-a26e-1ab70019f6df is not attached to volume 63005eb7-5c0f-4539-a9a8-78ff577cf415 Jun 30 12:37:59.256045 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:37:59.256045 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:37:59.256045 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:37:59.256045 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:37:59.256045 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:37:59.256045 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:37:59.256045 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 12:37:59.256045 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 12:37:59.256045 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d328d6c1-d49a-48c5-a26e-1ab70019f6df is not attached to volume 63005eb7-5c0f-4539-a9a8-78ff577cf415 Jun 30 12:37:59.256045 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:37:59.256045 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-0548f3f7-24f3-4dcc-ae56-d1beb3c4fb10 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Returning 404 to user: Instance d328d6c1-d49a-48c5-a26e-1ab70019f6df is not attached to volume 63005eb7-5c0f-4539-a9a8-78ff577cf415 {{(pid=124298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 12:37:59.258379 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-0548f3f7-24f3-4dcc-ae56-d1beb3c4fb10 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] 10.222.0.57 "DELETE /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df/os-volume_attachments/63005eb7-5c0f-4539-a9a8-78ff577cf415" status: 404 len: 154 microversion: 2.1 time: 0.130622 Jun 30 12:37:59.258379 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 257/525] 10.222.0.57 () {58 vars in 1415 bytes} [Thu Jun 30 12:37:59 2022] DELETE /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df/os-volume_attachments/63005eb7-5c0f-4539-a9a8-78ff577cf415 => generated 154 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 12:37:59.705450 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-5f3f8184-c86d-4726-a2a1-cb1c503eed3c tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:37:59.706336 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-5f3f8184-c86d-4726-a2a1-cb1c503eed3c tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 99ba3b96-6700-41e0-b2cf-ff8933b2bf94] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:37:59.712717 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-5f3f8184-c86d-4726-a2a1-cb1c503eed3c tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:59.713404 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-5f3f8184-c86d-4726-a2a1-cb1c503eed3c tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:59.714315 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-5f3f8184-c86d-4726-a2a1-cb1c503eed3c tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:59.714835 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-5f3f8184-c86d-4726-a2a1-cb1c503eed3c tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:59.890808 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-bd934e0f-990c-4e94-a524-8b05b5ad5c4b tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:37:59.892496 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-bd934e0f-990c-4e94-a524-8b05b5ad5c4b tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] [instance: 7d480b17-8874-4183-a7ec-3eed3d6bbb1b] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:37:59.900041 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-bd934e0f-990c-4e94-a524-8b05b5ad5c4b tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:59.900707 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-bd934e0f-990c-4e94-a524-8b05b5ad5c4b tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:37:59.902556 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-bd934e0f-990c-4e94-a524-8b05b5ad5c4b tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:37:59.903153 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-bd934e0f-990c-4e94-a524-8b05b5ad5c4b tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:00.030802 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-5f3f8184-c86d-4726-a2a1-cb1c503eed3c tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddb38b4d6864a6c96b84c9a4092eea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60d10dba1d947cc97149a063a810129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:38:00.041084 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-5f3f8184-c86d-4726-a2a1-cb1c503eed3c tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94" status: 200 len: 1672 microversion: 2.1 time: 0.340149 Jun 30 12:38:00.041918 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 269/526] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:37:59 2022] GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94 => generated 1672 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:38:00.150816 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-bd934e0f-990c-4e94-a524-8b05b5ad5c4b tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdc0eeb6cd443d78aefefca488d8c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3eabfe3692b44d8ae5f7d137ce1d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:38:00.160596 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-bd934e0f-990c-4e94-a524-8b05b5ad5c4b tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] 10.222.0.57 "GET /compute/v2.1/servers/7d480b17-8874-4183-a7ec-3eed3d6bbb1b" status: 200 len: 1318 microversion: 2.1 time: 0.275489 Jun 30 12:38:00.162214 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 258/527] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:37:59 2022] GET /compute/v2.1/servers/7d480b17-8874-4183-a7ec-3eed3d6bbb1b => generated 1318 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:38:00.315130 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [req-a5937b12-737e-41ce-bfe7-dc37c2cb8bc8 req-f71c22c9-7191-49df-9ba3-5febe2912261 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99ba3b96-6700-41e0-b2cf-ff8933b2bf94", "name": "network-vif-deleted", "tag": "3cb03b0c-2687-4749-9a21-f441e6a23823"}]} {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:38:00.326377 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [req-a5937b12-737e-41ce-bfe7-dc37c2cb8bc8 req-f71c22c9-7191-49df-9ba3-5febe2912261 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:00.327944 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [req-a5937b12-737e-41ce-bfe7-dc37c2cb8bc8 req-f71c22c9-7191-49df-9ba3-5febe2912261 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:00.347805 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.compute.server_external_events [req-a5937b12-737e-41ce-bfe7-dc37c2cb8bc8 req-f71c22c9-7191-49df-9ba3-5febe2912261 service nova] Creating event network-vif-deleted:3cb03b0c-2687-4749-9a21-f441e6a23823 for instance 99ba3b96-6700-41e0-b2cf-ff8933b2bf94 on hv-cinder-84614 Jun 30 12:38:00.354477 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [req-a5937b12-737e-41ce-bfe7-dc37c2cb8bc8 req-f71c22c9-7191-49df-9ba3-5febe2912261 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043199 Jun 30 12:38:00.356497 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 270/528] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 30 12:38:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:38:00.440936 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-fa4306a9-9d49-4c97-a8fc-9372e7f13805 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:00.441437 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-fa4306a9-9d49-4c97-a8fc-9372e7f13805 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] [instance: d328d6c1-d49a-48c5-a26e-1ab70019f6df] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:00.454453 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-fa4306a9-9d49-4c97-a8fc-9372e7f13805 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:00.454897 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-fa4306a9-9d49-4c97-a8fc-9372e7f13805 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:00.455660 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-fa4306a9-9d49-4c97-a8fc-9372e7f13805 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:00.456260 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-fa4306a9-9d49-4c97-a8fc-9372e7f13805 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:00.460991 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG dbcounter [-] [124298] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=124298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:00.484513 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-fa4306a9-9d49-4c97-a8fc-9372e7f13805 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] [instance: d328d6c1-d49a-48c5-a26e-1ab70019f6df] Going to try to terminate instance {{(pid=124298) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 12:38:00.576680 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-fa4306a9-9d49-4c97-a8fc-9372e7f13805 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] 10.222.0.57 "DELETE /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df" status: 204 len: 0 microversion: 2.1 time: 0.140047 Jun 30 12:38:00.577573 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 259/529] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 30 12:38:00 2022] DELETE /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 12:38:00.591722 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-dc031818-da5a-46f4-908f-b2836e577533 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:00.593130 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-dc031818-da5a-46f4-908f-b2836e577533 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] [instance: d328d6c1-d49a-48c5-a26e-1ab70019f6df] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:00.604693 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-dc031818-da5a-46f4-908f-b2836e577533 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:00.605150 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-dc031818-da5a-46f4-908f-b2836e577533 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:00.605935 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-dc031818-da5a-46f4-908f-b2836e577533 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:00.606370 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-dc031818-da5a-46f4-908f-b2836e577533 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:00.638057 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [req-41b09448-027b-40c2-bb79-65c7e02cbe21 req-a868c2aa-94de-4990-88b6-67375f760f7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d480b17-8874-4183-a7ec-3eed3d6bbb1b", "tag": "2d091604-c7cf-4cf1-a44d-5310eae90174"}]} {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:38:00.652154 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [req-41b09448-027b-40c2-bb79-65c7e02cbe21 req-a868c2aa-94de-4990-88b6-67375f760f7d service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:00.653843 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [req-41b09448-027b-40c2-bb79-65c7e02cbe21 req-a868c2aa-94de-4990-88b6-67375f760f7d service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:00.674281 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.compute.server_external_events [req-41b09448-027b-40c2-bb79-65c7e02cbe21 req-a868c2aa-94de-4990-88b6-67375f760f7d service nova] Creating event network-changed:2d091604-c7cf-4cf1-a44d-5310eae90174 for instance 7d480b17-8874-4183-a7ec-3eed3d6bbb1b on hv-cinder-84614 Jun 30 12:38:00.679170 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [req-41b09448-027b-40c2-bb79-65c7e02cbe21 req-a868c2aa-94de-4990-88b6-67375f760f7d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045431 Jun 30 12:38:00.680145 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 260/530] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 30 12:38:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:38:00.774369 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-dc031818-da5a-46f4-908f-b2836e577533 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc65fea19f94fd18d83ad8ce3bbb476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a42d5073b0f4e4c857d794aa8d30393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:38:00.782118 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-dc031818-da5a-46f4-908f-b2836e577533 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] 10.222.0.57 "GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df" status: 200 len: 1554 microversion: 2.1 time: 0.197005 Jun 30 12:38:00.783051 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 271/531] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:38:00 2022] GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df => generated 1554 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:38:01.059504 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-c99e02a3-073e-4722-8348-0053c387fd00 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:01.060406 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-c99e02a3-073e-4722-8348-0053c387fd00 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 99ba3b96-6700-41e0-b2cf-ff8933b2bf94] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:01.068739 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-c99e02a3-073e-4722-8348-0053c387fd00 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:01.070050 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-c99e02a3-073e-4722-8348-0053c387fd00 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:01.070821 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-c99e02a3-073e-4722-8348-0053c387fd00 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:01.071362 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-c99e02a3-073e-4722-8348-0053c387fd00 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:01.105264 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-c99e02a3-073e-4722-8348-0053c387fd00 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:01.105684 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-c99e02a3-073e-4722-8348-0053c387fd00 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:01.106165 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.objects.instance [None req-c99e02a3-073e-4722-8348-0053c387fd00 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lazy-loading 'fault' on Instance uuid 99ba3b96-6700-41e0-b2cf-ff8933b2bf94 {{(pid=124298) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 12:38:01.154219 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-c99e02a3-073e-4722-8348-0053c387fd00 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddb38b4d6864a6c96b84c9a4092eea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60d10dba1d947cc97149a063a810129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:38:01.163869 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-c99e02a3-073e-4722-8348-0053c387fd00 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94" status: 200 len: 1326 microversion: 2.1 time: 0.108747 Jun 30 12:38:01.164575 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 261/532] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:38:01 2022] GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94 => generated 1326 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:38:01.182312 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-3e558809-cc15-4a1e-a761-b50410c13e46 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:01.182927 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-3e558809-cc15-4a1e-a761-b50410c13e46 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] [instance: 7d480b17-8874-4183-a7ec-3eed3d6bbb1b] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:01.189844 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-3e558809-cc15-4a1e-a761-b50410c13e46 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:01.190531 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-3e558809-cc15-4a1e-a761-b50410c13e46 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:01.191494 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-3e558809-cc15-4a1e-a761-b50410c13e46 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:01.192092 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-3e558809-cc15-4a1e-a761-b50410c13e46 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:01.332902 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-3e558809-cc15-4a1e-a761-b50410c13e46 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdc0eeb6cd443d78aefefca488d8c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3eabfe3692b44d8ae5f7d137ce1d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:38:01.341668 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-3e558809-cc15-4a1e-a761-b50410c13e46 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] 10.222.0.57 "GET /compute/v2.1/servers/7d480b17-8874-4183-a7ec-3eed3d6bbb1b" status: 200 len: 1318 microversion: 2.1 time: 0.163331 Jun 30 12:38:01.342588 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 272/533] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:38:01 2022] GET /compute/v2.1/servers/7d480b17-8874-4183-a7ec-3eed3d6bbb1b => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:38:01.801455 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-9b7074a8-bba1-4d9e-abff-527e500fc6a5 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:01.802239 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-9b7074a8-bba1-4d9e-abff-527e500fc6a5 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] [instance: d328d6c1-d49a-48c5-a26e-1ab70019f6df] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:01.808897 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-9b7074a8-bba1-4d9e-abff-527e500fc6a5 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:01.809353 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-9b7074a8-bba1-4d9e-abff-527e500fc6a5 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:01.810144 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-9b7074a8-bba1-4d9e-abff-527e500fc6a5 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:01.810579 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-9b7074a8-bba1-4d9e-abff-527e500fc6a5 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:01.950964 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-9b7074a8-bba1-4d9e-abff-527e500fc6a5 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc65fea19f94fd18d83ad8ce3bbb476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a42d5073b0f4e4c857d794aa8d30393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:38:01.959230 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-9b7074a8-bba1-4d9e-abff-527e500fc6a5 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] 10.222.0.57 "GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df" status: 200 len: 1554 microversion: 2.1 time: 0.161669 Jun 30 12:38:01.969374 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 262/534] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:38:01 2022] GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df => generated 1554 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:38:02.185230 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-0aa520fa-bd09-4d08-a9a3-c57741c9b996 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:02.186251 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-0aa520fa-bd09-4d08-a9a3-c57741c9b996 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 99ba3b96-6700-41e0-b2cf-ff8933b2bf94] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:02.193989 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-0aa520fa-bd09-4d08-a9a3-c57741c9b996 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:02.194437 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-0aa520fa-bd09-4d08-a9a3-c57741c9b996 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:02.195203 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-0aa520fa-bd09-4d08-a9a3-c57741c9b996 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:02.195635 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-0aa520fa-bd09-4d08-a9a3-c57741c9b996 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:02.227216 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-0aa520fa-bd09-4d08-a9a3-c57741c9b996 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:02.227585 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-0aa520fa-bd09-4d08-a9a3-c57741c9b996 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:02.228023 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.objects.instance [None req-0aa520fa-bd09-4d08-a9a3-c57741c9b996 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lazy-loading 'fault' on Instance uuid 99ba3b96-6700-41e0-b2cf-ff8933b2bf94 {{(pid=124297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 12:38:02.273060 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-0aa520fa-bd09-4d08-a9a3-c57741c9b996 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddb38b4d6864a6c96b84c9a4092eea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60d10dba1d947cc97149a063a810129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:38:02.280496 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-0aa520fa-bd09-4d08-a9a3-c57741c9b996 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94" status: 200 len: 1326 microversion: 2.1 time: 0.101508 Jun 30 12:38:02.281102 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 273/535] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:38:02 2022] GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94 => generated 1326 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:38:02.361544 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-bb252181-bf88-49ee-8c5f-a8a2f2b07fec tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:02.362129 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-bb252181-bf88-49ee-8c5f-a8a2f2b07fec tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] [instance: 7d480b17-8874-4183-a7ec-3eed3d6bbb1b] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:02.369748 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-bb252181-bf88-49ee-8c5f-a8a2f2b07fec tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:02.370274 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-bb252181-bf88-49ee-8c5f-a8a2f2b07fec tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:02.371246 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-bb252181-bf88-49ee-8c5f-a8a2f2b07fec tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:02.371688 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-bb252181-bf88-49ee-8c5f-a8a2f2b07fec tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:02.558912 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-bb252181-bf88-49ee-8c5f-a8a2f2b07fec tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdc0eeb6cd443d78aefefca488d8c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3eabfe3692b44d8ae5f7d137ce1d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:38:02.570052 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-bb252181-bf88-49ee-8c5f-a8a2f2b07fec tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] 10.222.0.57 "GET /compute/v2.1/servers/7d480b17-8874-4183-a7ec-3eed3d6bbb1b" status: 200 len: 1318 microversion: 2.1 time: 0.214348 Jun 30 12:38:02.570609 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 263/536] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:38:02 2022] GET /compute/v2.1/servers/7d480b17-8874-4183-a7ec-3eed3d6bbb1b => generated 1318 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:38:02.976845 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-8c566f3d-cd4f-43ee-bd79-23d034ff51d7 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:02.977531 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-8c566f3d-cd4f-43ee-bd79-23d034ff51d7 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] [instance: d328d6c1-d49a-48c5-a26e-1ab70019f6df] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:02.984061 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-8c566f3d-cd4f-43ee-bd79-23d034ff51d7 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:02.984761 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-8c566f3d-cd4f-43ee-bd79-23d034ff51d7 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:02.985964 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-8c566f3d-cd4f-43ee-bd79-23d034ff51d7 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:02.986690 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-8c566f3d-cd4f-43ee-bd79-23d034ff51d7 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:03.214450 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-8c566f3d-cd4f-43ee-bd79-23d034ff51d7 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc65fea19f94fd18d83ad8ce3bbb476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a42d5073b0f4e4c857d794aa8d30393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:38:03.225828 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-8c566f3d-cd4f-43ee-bd79-23d034ff51d7 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] 10.222.0.57 "GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df" status: 200 len: 1554 microversion: 2.1 time: 0.252872 Jun 30 12:38:03.226423 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 274/537] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:38:02 2022] GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df => generated 1554 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:38:03.251009 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [req-740d6337-ba24-4302-91da-44d60748e338 req-30a4a310-4b1a-4376-9c59-0dd551e215cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d328d6c1-d49a-48c5-a26e-1ab70019f6df", "name": "network-vif-deleted", "tag": "a04c1ee8-5a15-46b6-87ec-288a776bc842"}]} {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:38:03.261883 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [req-740d6337-ba24-4302-91da-44d60748e338 req-30a4a310-4b1a-4376-9c59-0dd551e215cd service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:03.262457 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [req-740d6337-ba24-4302-91da-44d60748e338 req-30a4a310-4b1a-4376-9c59-0dd551e215cd service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:03.278095 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.compute.server_external_events [req-740d6337-ba24-4302-91da-44d60748e338 req-30a4a310-4b1a-4376-9c59-0dd551e215cd service nova] Creating event network-vif-deleted:a04c1ee8-5a15-46b6-87ec-288a776bc842 for instance d328d6c1-d49a-48c5-a26e-1ab70019f6df on hv-cinder-84614 Jun 30 12:38:03.284982 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [req-740d6337-ba24-4302-91da-44d60748e338 req-30a4a310-4b1a-4376-9c59-0dd551e215cd service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037681 Jun 30 12:38:03.286945 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 264/538] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 30 12:38:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:38:03.299439 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-a94daa69-9d3c-4f01-844c-9622916a1cfb tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:03.300152 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-a94daa69-9d3c-4f01-844c-9622916a1cfb tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 99ba3b96-6700-41e0-b2cf-ff8933b2bf94] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:03.307536 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-a94daa69-9d3c-4f01-844c-9622916a1cfb tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:03.308170 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-a94daa69-9d3c-4f01-844c-9622916a1cfb tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:03.309146 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-a94daa69-9d3c-4f01-844c-9622916a1cfb tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:03.309572 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-a94daa69-9d3c-4f01-844c-9622916a1cfb tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:03.314546 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG dbcounter [-] [124297] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:03.325271 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.wsgi [None req-a94daa69-9d3c-4f01-844c-9622916a1cfb tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] HTTP exception thrown: Instance 99ba3b96-6700-41e0-b2cf-ff8933b2bf94 could not be found. Jun 30 12:38:03.326922 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-a94daa69-9d3c-4f01-844c-9622916a1cfb tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Request method failure captured: Jun 30 12:38:03.326922 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: request: GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94 HTTP/1.1 Jun 30 12:38:03.326922 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Accept: application/json Jun 30 12:38:03.326922 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Accept-Encoding: identity Jun 30 12:38:03.326922 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Connection: close Jun 30 12:38:03.326922 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Content-Length: 0 Jun 30 12:38:03.326922 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Content-Type: application/json Jun 30 12:38:03.326922 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Host: 10.222.0.57 Jun 30 12:38:03.326922 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Openstack-System-Scope: None Jun 30 12:38:03.326922 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: User-Agent: python-urllib3/1.26.9 Jun 30 12:38:03.326922 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Auth-Token: gAAAAABivZf4l2uN2l7MZf1ZhxzVFfts0wg0_KMAarn_6hpljXzQrjCE_nI8N7K9WLga4GIDF0IaS7huxljiZYYC8_sdgJ99DASpal2KKCfcwxDzeH2kiKHCakZvOuVM8Hd3lglaApvXhJAuoMzyvjLzbCFt5-vglJcWrsab-0Ua-0r9pZ9hVWM Jun 30 12:38:03.326922 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Domain-Id: None Jun 30 12:38:03.326922 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Domain-Name: None Jun 30 12:38:03.326922 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Identity-Status: Confirmed Jun 30 12:38:03.326922 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Is-Admin-Project: True Jun 30 12:38:03.326922 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Project-Domain-Id: default Jun 30 12:38:03.326922 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Project-Domain-Name: Default Jun 30 12:38:03.326922 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Project-Id: b60d10dba1d947cc97149a063a810129 Jun 30 12:38:03.326922 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Project-Name: tempest-AttachVolumeTestJSON-868731092 Jun 30 12:38:03.326922 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Role: member,reader Jun 30 12:38:03.326922 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Roles: member,reader Jun 30 12:38:03.328508 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/b60d10dba1d947cc97149a063a810129"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b60d10dba1d947cc97149a063a810129"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_b60d10dba1d947cc97149a063a810129", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b60d10dba1d947cc97149a063a810129"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 30 12:38:03.328508 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Tenant: tempest-AttachVolumeTestJSON-868731092 Jun 30 12:38:03.328508 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Tenant-Id: b60d10dba1d947cc97149a063a810129 Jun 30 12:38:03.328508 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Tenant-Name: tempest-AttachVolumeTestJSON-868731092 Jun 30 12:38:03.328508 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User: tempest-AttachVolumeTestJSON-868731092-project Jun 30 12:38:03.328508 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User-Domain-Id: default Jun 30 12:38:03.328508 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User-Domain-Name: Default Jun 30 12:38:03.328508 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User-Id: 6ddb38b4d6864a6c96b84c9a4092eea8 Jun 30 12:38:03.328508 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User-Name: tempest-AttachVolumeTestJSON-868731092-project Jun 30 12:38:03.328508 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: method: > Jun 30 12:38:03.328508 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: exception: Instance 99ba3b96-6700-41e0-b2cf-ff8933b2bf94 could not be found. Jun 30 12:38:03.328508 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: action_args: {'id': '99ba3b96-6700-41e0-b2cf-ff8933b2bf94'} Jun 30 12:38:03.330205 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 12:38:03.330205 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:38:03.330205 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 12:38:03.330205 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 12:38:03.330205 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 12:38:03.330205 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 12:38:03.330205 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 12:38:03.330205 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 12:38:03.330205 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 12:38:03.330205 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 12:38:03.330205 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99ba3b96-6700-41e0-b2cf-ff8933b2bf94 could not be found. Jun 30 12:38:03.330205 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:38:03.330205 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:38:03.330205 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:38:03.330205 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:38:03.330205 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:38:03.330205 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:38:03.330205 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 12:38:03.330205 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 12:38:03.330205 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 12:38:03.331428 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 12:38:03.331428 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 12:38:03.331428 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 12:38:03.331428 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 12:38:03.331428 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 12:38:03.331428 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 12:38:03.331428 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 12:38:03.331428 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99ba3b96-6700-41e0-b2cf-ff8933b2bf94 could not be found. Jun 30 12:38:03.331428 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:38:03.331428 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:38:03.331428 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:38:03.331428 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:38:03.331428 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:38:03.331428 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:38:03.331428 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 12:38:03.331428 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 12:38:03.331428 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99ba3b96-6700-41e0-b2cf-ff8933b2bf94 could not be found. Jun 30 12:38:03.331428 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:38:03.332485 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-a94daa69-9d3c-4f01-844c-9622916a1cfb tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Returning 404 to user: Instance 99ba3b96-6700-41e0-b2cf-ff8933b2bf94 could not be found. {{(pid=124297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 12:38:03.332485 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-a94daa69-9d3c-4f01-844c-9622916a1cfb tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94" status: 404 len: 111 microversion: 2.1 time: 0.037006 Jun 30 12:38:03.332485 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 275/539] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:38:03 2022] GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 12:38:03.341348 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-c6c214eb-e099-41de-8f1e-ad355195aa26 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '.version_select at 0x7fd0e02ff550>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:03.344900 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c6c214eb-e099-41de-8f1e-ad355195aa26 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [d4a87e04-0048-4f55-ac32-e9a061b54a29] AMQP server on 10.222.0.57:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 30 12:38:03.587769 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-5062a3e5-5f51-41b8-bc52-4275afc8bbb9 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:03.588368 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-5062a3e5-5f51-41b8-bc52-4275afc8bbb9 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] [instance: 7d480b17-8874-4183-a7ec-3eed3d6bbb1b] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:03.595854 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-5062a3e5-5f51-41b8-bc52-4275afc8bbb9 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:03.596268 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-5062a3e5-5f51-41b8-bc52-4275afc8bbb9 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:03.597301 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-5062a3e5-5f51-41b8-bc52-4275afc8bbb9 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:03.597737 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-5062a3e5-5f51-41b8-bc52-4275afc8bbb9 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:03.733187 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-5062a3e5-5f51-41b8-bc52-4275afc8bbb9 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdc0eeb6cd443d78aefefca488d8c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3eabfe3692b44d8ae5f7d137ce1d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:38:03.741185 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-5062a3e5-5f51-41b8-bc52-4275afc8bbb9 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] 10.222.0.57 "GET /compute/v2.1/servers/7d480b17-8874-4183-a7ec-3eed3d6bbb1b" status: 200 len: 1318 microversion: 2.1 time: 0.157582 Jun 30 12:38:03.741784 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 276/540] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:38:03 2022] GET /compute/v2.1/servers/7d480b17-8874-4183-a7ec-3eed3d6bbb1b => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:38:04.247431 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-5c971408-8204-4f26-9750-f3712dc8cd09 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:04.248377 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-5c971408-8204-4f26-9750-f3712dc8cd09 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] [instance: d328d6c1-d49a-48c5-a26e-1ab70019f6df] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:04.256536 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-5c971408-8204-4f26-9750-f3712dc8cd09 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:04.257014 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-5c971408-8204-4f26-9750-f3712dc8cd09 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:04.257783 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-5c971408-8204-4f26-9750-f3712dc8cd09 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:04.258217 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-5c971408-8204-4f26-9750-f3712dc8cd09 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:04.290399 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-5c971408-8204-4f26-9750-f3712dc8cd09 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:04.290845 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-5c971408-8204-4f26-9750-f3712dc8cd09 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:04.291302 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.objects.instance [None req-5c971408-8204-4f26-9750-f3712dc8cd09 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lazy-loading 'fault' on Instance uuid d328d6c1-d49a-48c5-a26e-1ab70019f6df {{(pid=124297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 12:38:04.337146 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-5c971408-8204-4f26-9750-f3712dc8cd09 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc65fea19f94fd18d83ad8ce3bbb476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a42d5073b0f4e4c857d794aa8d30393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:38:04.347717 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-5c971408-8204-4f26-9750-f3712dc8cd09 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] 10.222.0.57 "GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df" status: 200 len: 1349 microversion: 2.1 time: 0.106674 Jun 30 12:38:04.349797 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 277/541] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:38:04 2022] GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df => generated 1349 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:38:04.352392 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO oslo.messaging._drivers.impl_rabbit [None req-c6c214eb-e099-41de-8f1e-ad355195aa26 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [d4a87e04-0048-4f55-ac32-e9a061b54a29] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 34064. Jun 30 12:38:04.377374 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-c6c214eb-e099-41de-8f1e-ad355195aa26 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-13269952" status: 202 len: 0 microversion: 2.1 time: 1.040547 Jun 30 12:38:04.377966 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 265/542] 10.222.0.57 () {58 vars in 1214 bytes} [Thu Jun 30 12:38:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-13269952 => generated 0 bytes in 1042 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 12:38:04.759724 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-5fe1480b-9ab0-4607-95f9-f6e601dbbe72 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:04.760723 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-5fe1480b-9ab0-4607-95f9-f6e601dbbe72 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] [instance: 7d480b17-8874-4183-a7ec-3eed3d6bbb1b] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:04.768960 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-5fe1480b-9ab0-4607-95f9-f6e601dbbe72 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:04.769401 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-5fe1480b-9ab0-4607-95f9-f6e601dbbe72 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:04.770170 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-5fe1480b-9ab0-4607-95f9-f6e601dbbe72 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:04.770601 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-5fe1480b-9ab0-4607-95f9-f6e601dbbe72 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:04.908361 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-5fe1480b-9ab0-4607-95f9-f6e601dbbe72 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdc0eeb6cd443d78aefefca488d8c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3eabfe3692b44d8ae5f7d137ce1d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:38:04.917175 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-5fe1480b-9ab0-4607-95f9-f6e601dbbe72 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] 10.222.0.57 "GET /compute/v2.1/servers/7d480b17-8874-4183-a7ec-3eed3d6bbb1b" status: 200 len: 1318 microversion: 2.1 time: 0.162787 Jun 30 12:38:04.917760 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 278/543] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:38:04 2022] GET /compute/v2.1/servers/7d480b17-8874-4183-a7ec-3eed3d6bbb1b => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:38:05.042806 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-f6225aa6-74fa-4bd5-93de-81398641faf8 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Action: 'create', calling method: .version_select at 0x7fd0e0245700>, body: {"keypair": {"name": "tempest-keypair-102205801", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLjBp3aAl7oXzHkzEnQa532kE0+VrxecqerOYkH6rY/KDeduL3dvLqdxJjqj5YZ6YYfKOkJET5hihRgdmuyER4zqgtCaTt2lbrw9+2qdpV5DWVdqj1Nz5ToW9i/A4WokFg=="}} {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:38:05.058704 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.quota [None req-f6225aa6-74fa-4bd5-93de-81398641faf8 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Getting quotas for project b60d10dba1d947cc97149a063a810129. Resources: {'key_pairs'} {{(pid=124298) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 12:38:05.063037 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.quota [None req-f6225aa6-74fa-4bd5-93de-81398641faf8 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Getting quotas for user 6ddb38b4d6864a6c96b84c9a4092eea8 and project b60d10dba1d947cc97149a063a810129. Resources: {'key_pairs'} {{(pid=124298) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 12:38:05.086799 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-f6225aa6-74fa-4bd5-93de-81398641faf8 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.048037 Jun 30 12:38:05.087431 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 266/544] 10.222.0.57 () {60 vars in 1158 bytes} [Thu Jun 30 12:38:05 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:38:05.367915 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-61506101-9665-45a6-8d71-ef7b2cb6c206 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:05.368479 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-61506101-9665-45a6-8d71-ef7b2cb6c206 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] [instance: d328d6c1-d49a-48c5-a26e-1ab70019f6df] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:05.375609 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-61506101-9665-45a6-8d71-ef7b2cb6c206 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:05.376478 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-61506101-9665-45a6-8d71-ef7b2cb6c206 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:05.377358 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-61506101-9665-45a6-8d71-ef7b2cb6c206 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:05.378002 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-61506101-9665-45a6-8d71-ef7b2cb6c206 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:05.402767 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.wsgi [None req-61506101-9665-45a6-8d71-ef7b2cb6c206 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] HTTP exception thrown: Instance d328d6c1-d49a-48c5-a26e-1ab70019f6df could not be found. Jun 30 12:38:05.404354 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-61506101-9665-45a6-8d71-ef7b2cb6c206 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Request method failure captured: Jun 30 12:38:05.404354 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: request: GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df HTTP/1.1 Jun 30 12:38:05.404354 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Accept: application/json Jun 30 12:38:05.404354 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Accept-Encoding: identity Jun 30 12:38:05.404354 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Connection: close Jun 30 12:38:05.404354 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Content-Length: 0 Jun 30 12:38:05.404354 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Content-Type: application/json Jun 30 12:38:05.404354 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Host: 10.222.0.57 Jun 30 12:38:05.404354 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Openstack-System-Scope: None Jun 30 12:38:05.404354 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: User-Agent: python-urllib3/1.26.9 Jun 30 12:38:05.404354 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Auth-Token: gAAAAABivZheQJ0SiTVTyN-_2sc5xGyHlrWZFWYITtQ54LkMEBU-fJS-BKUmxnOCLvEhm_El1iY3arGkvaCuDznKPZp18g1Za7FVkmt7729uUnbI7k-PreJasMSwfVkcG4kL6mWUe3J9PKgOMBPP-z-I8mESaEyiO5Dub-2zsX43jBWFTJQ1pE8 Jun 30 12:38:05.404354 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Domain-Id: None Jun 30 12:38:05.404354 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Domain-Name: None Jun 30 12:38:05.404354 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Identity-Status: Confirmed Jun 30 12:38:05.404354 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Is-Admin-Project: True Jun 30 12:38:05.404354 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Project-Domain-Id: default Jun 30 12:38:05.404354 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Project-Domain-Name: Default Jun 30 12:38:05.404354 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Project-Id: 4a42d5073b0f4e4c857d794aa8d30393 Jun 30 12:38:05.404354 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Project-Name: tempest-TestMinimumBasicScenario-181108139 Jun 30 12:38:05.404354 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Role: member,reader Jun 30 12:38:05.404354 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Roles: member,reader Jun 30 12:38:05.406037 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/4a42d5073b0f4e4c857d794aa8d30393"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4a42d5073b0f4e4c857d794aa8d30393"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_4a42d5073b0f4e4c857d794aa8d30393", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4a42d5073b0f4e4c857d794aa8d30393"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 30 12:38:05.406037 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Tenant: tempest-TestMinimumBasicScenario-181108139 Jun 30 12:38:05.406037 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Tenant-Id: 4a42d5073b0f4e4c857d794aa8d30393 Jun 30 12:38:05.406037 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Tenant-Name: tempest-TestMinimumBasicScenario-181108139 Jun 30 12:38:05.406037 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User: tempest-TestMinimumBasicScenario-181108139-project Jun 30 12:38:05.406037 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User-Domain-Id: default Jun 30 12:38:05.406037 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User-Domain-Name: Default Jun 30 12:38:05.406037 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User-Id: 1fc65fea19f94fd18d83ad8ce3bbb476 Jun 30 12:38:05.406037 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User-Name: tempest-TestMinimumBasicScenario-181108139-project Jun 30 12:38:05.406037 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: method: > Jun 30 12:38:05.406037 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: exception: Instance d328d6c1-d49a-48c5-a26e-1ab70019f6df could not be found. Jun 30 12:38:05.406037 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: action_args: {'id': 'd328d6c1-d49a-48c5-a26e-1ab70019f6df'} Jun 30 12:38:05.407046 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 12:38:05.407046 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:38:05.407046 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 12:38:05.407046 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 12:38:05.407046 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 12:38:05.407046 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 12:38:05.407046 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 12:38:05.407046 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 12:38:05.407046 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 12:38:05.407046 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 12:38:05.407046 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d328d6c1-d49a-48c5-a26e-1ab70019f6df could not be found. Jun 30 12:38:05.407046 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:38:05.407046 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:38:05.407046 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:38:05.407046 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:38:05.407046 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:38:05.407046 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:38:05.407046 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 12:38:05.407046 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 12:38:05.407046 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 12:38:05.408585 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 12:38:05.408585 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 12:38:05.408585 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 12:38:05.408585 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 12:38:05.408585 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 12:38:05.408585 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 12:38:05.408585 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 12:38:05.408585 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d328d6c1-d49a-48c5-a26e-1ab70019f6df could not be found. Jun 30 12:38:05.408585 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:38:05.408585 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:38:05.408585 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:38:05.408585 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:38:05.408585 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:38:05.408585 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:38:05.408585 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 12:38:05.408585 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 12:38:05.408585 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d328d6c1-d49a-48c5-a26e-1ab70019f6df could not be found. Jun 30 12:38:05.408585 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:38:05.410063 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-61506101-9665-45a6-8d71-ef7b2cb6c206 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Returning 404 to user: Instance d328d6c1-d49a-48c5-a26e-1ab70019f6df could not be found. {{(pid=124297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 12:38:05.410063 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-61506101-9665-45a6-8d71-ef7b2cb6c206 tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] 10.222.0.57 "GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df" status: 404 len: 111 microversion: 2.1 time: 0.042115 Jun 30 12:38:05.410937 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 279/545] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:38:05 2022] GET /compute/v2.1/servers/d328d6c1-d49a-48c5-a26e-1ab70019f6df => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 12:38:05.416650 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-421e0ed8-7d70-4bbd-8446-431dfcace8ac tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] Calling method '.version_select at 0x7fd0e0513160>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:05.435489 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-421e0ed8-7d70-4bbd-8446-431dfcace8ac tempest-TestMinimumBasicScenario-181108139 tempest-TestMinimumBasicScenario-181108139-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1683758013" status: 202 len: 0 microversion: 2.1 time: 0.023272 Jun 30 12:38:05.436143 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 267/546] 10.222.0.57 () {58 vars in 1271 bytes} [Thu Jun 30 12:38:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1683758013 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 30 12:38:05.935058 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-5481da1d-fef2-462b-a57c-ecbf3b831bf1 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:05.935770 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-5481da1d-fef2-462b-a57c-ecbf3b831bf1 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] [instance: 7d480b17-8874-4183-a7ec-3eed3d6bbb1b] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:05.943318 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-5481da1d-fef2-462b-a57c-ecbf3b831bf1 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:05.943768 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-5481da1d-fef2-462b-a57c-ecbf3b831bf1 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:05.945458 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-5481da1d-fef2-462b-a57c-ecbf3b831bf1 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:05.945458 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-5481da1d-fef2-462b-a57c-ecbf3b831bf1 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:06.103209 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-5481da1d-fef2-462b-a57c-ecbf3b831bf1 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdc0eeb6cd443d78aefefca488d8c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3eabfe3692b44d8ae5f7d137ce1d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:38:06.110710 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-5481da1d-fef2-462b-a57c-ecbf3b831bf1 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] 10.222.0.57 "GET /compute/v2.1/servers/7d480b17-8874-4183-a7ec-3eed3d6bbb1b" status: 200 len: 1318 microversion: 2.1 time: 0.180404 Jun 30 12:38:06.111878 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 280/547] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:38:05 2022] GET /compute/v2.1/servers/7d480b17-8874-4183-a7ec-3eed3d6bbb1b => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:38:06.444620 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-43806f74-628d-44ad-93d8-c9233aa8efde tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-387367514", "imageRef": "776a1662-a241-4e20-9a9c-e4743c64efd0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "36b59ef7-ad33-4935-9d99-c2dc624851fa"}], "security_groups": [{"name": "tempest-securitygroup--463838885"}], "key_name": "tempest-keypair-102205801", "user_data": "}} {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:38:06.629475 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.network.neutron [None req-43806f74-628d-44ad-93d8-c9233aa8efde tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] validate_networks() for [('36b59ef7-ad33-4935-9d99-c2dc624851fa', None, None, None, None, None)] {{(pid=124298) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 12:38:07.127873 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-41d797d0-f078-491c-a643-792e4ddd0c56 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:07.128472 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-41d797d0-f078-491c-a643-792e4ddd0c56 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] [instance: 7d480b17-8874-4183-a7ec-3eed3d6bbb1b] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:07.130836 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG dbcounter [-] [124297] Writing DB stats nova_cell0:SELECT=2 {{(pid=124297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:07.131516 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG dbcounter [-] [124297] Writing DB stats nova_cell0:SELECT=6 {{(pid=124297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:07.137469 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-41d797d0-f078-491c-a643-792e4ddd0c56 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:07.137947 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-41d797d0-f078-491c-a643-792e4ddd0c56 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:07.138727 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-41d797d0-f078-491c-a643-792e4ddd0c56 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:07.139161 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-41d797d0-f078-491c-a643-792e4ddd0c56 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:07.416785 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-41d797d0-f078-491c-a643-792e4ddd0c56 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdc0eeb6cd443d78aefefca488d8c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3eabfe3692b44d8ae5f7d137ce1d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:38:07.424784 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-41d797d0-f078-491c-a643-792e4ddd0c56 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] 10.222.0.57 "GET /compute/v2.1/servers/7d480b17-8874-4183-a7ec-3eed3d6bbb1b" status: 200 len: 1318 microversion: 2.1 time: 0.300900 Jun 30 12:38:07.425361 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 281/548] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:38:07 2022] GET /compute/v2.1/servers/7d480b17-8874-4183-a7ec-3eed3d6bbb1b => generated 1318 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:38:07.618293 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.virt.hardware [None req-43806f74-628d-44ad-93d8-c9233aa8efde tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Flavor limits 0:0:0 {{(pid=124298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 12:38:07.618828 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.virt.hardware [None req-43806f74-628d-44ad-93d8-c9233aa8efde tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Image limits 0:0:0 {{(pid=124298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 12:38:07.619171 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.virt.hardware [None req-43806f74-628d-44ad-93d8-c9233aa8efde tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Flavor pref 0:0:0 {{(pid=124298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 12:38:07.619584 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.virt.hardware [None req-43806f74-628d-44ad-93d8-c9233aa8efde tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Image pref 0:0:0 {{(pid=124298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 12:38:07.619989 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.virt.hardware [None req-43806f74-628d-44ad-93d8-c9233aa8efde tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 12:38:07.629473 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-43806f74-628d-44ad-93d8-c9233aa8efde tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:07.629916 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-43806f74-628d-44ad-93d8-c9233aa8efde tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:07.630722 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-43806f74-628d-44ad-93d8-c9233aa8efde tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:07.631155 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-43806f74-628d-44ad-93d8-c9233aa8efde tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:07.649618 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.quota [None req-43806f74-628d-44ad-93d8-c9233aa8efde tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Getting quotas for project b60d10dba1d947cc97149a063a810129. Resources: {'cores', 'ram', 'instances'} {{(pid=124298) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 12:38:07.654646 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.quota [None req-43806f74-628d-44ad-93d8-c9233aa8efde tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Getting quotas for user 6ddb38b4d6864a6c96b84c9a4092eea8 and project b60d10dba1d947cc97149a063a810129. Resources: {'cores', 'ram', 'instances'} {{(pid=124298) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 12:38:07.667116 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-43806f74-628d-44ad-93d8-c9233aa8efde tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Going to run 1 instances... {{(pid=124298) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 12:38:07.669744 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-43806f74-628d-44ad-93d8-c9233aa8efde tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 973c1877-9855-432d-819a-cdfcc917d844] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='776a1662-a241-4e20-9a9c-e4743c64efd0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124298) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 12:38:07.681840 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG dbcounter [-] [124298] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=3,nova_api:DELETE=2,nova_api:INSERT=2 {{(pid=124298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:07.726361 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-43806f74-628d-44ad-93d8-c9233aa8efde tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.286602 Jun 30 12:38:07.727476 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 268/549] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 30 12:38:06 2022] POST /compute/v2.1/servers => generated 401 bytes in 1288 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 30 12:38:07.737805 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-0ea98c5a-687d-4ca7-af96-5246d2881d6d tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:07.738414 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-0ea98c5a-687d-4ca7-af96-5246d2881d6d tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 973c1877-9855-432d-819a-cdfcc917d844] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:07.828119 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-0ea98c5a-687d-4ca7-af96-5246d2881d6d tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddb38b4d6864a6c96b84c9a4092eea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60d10dba1d947cc97149a063a810129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:38:07.837866 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-0ea98c5a-687d-4ca7-af96-5246d2881d6d tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/973c1877-9855-432d-819a-cdfcc917d844" status: 200 len: 1236 microversion: 2.1 time: 0.104193 Jun 30 12:38:07.841704 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 282/550] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:38:07 2022] GET /compute/v2.1/servers/973c1877-9855-432d-819a-cdfcc917d844 => generated 1236 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:38:08.444791 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-4b5518ca-711d-4045-a507-e1e5ea5ec419 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:08.445816 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-4b5518ca-711d-4045-a507-e1e5ea5ec419 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] [instance: 7d480b17-8874-4183-a7ec-3eed3d6bbb1b] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:08.457282 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-4b5518ca-711d-4045-a507-e1e5ea5ec419 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:08.457973 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-4b5518ca-711d-4045-a507-e1e5ea5ec419 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:08.458969 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-4b5518ca-711d-4045-a507-e1e5ea5ec419 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:08.459795 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-4b5518ca-711d-4045-a507-e1e5ea5ec419 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:08.706111 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-4b5518ca-711d-4045-a507-e1e5ea5ec419 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdc0eeb6cd443d78aefefca488d8c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3eabfe3692b44d8ae5f7d137ce1d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:38:08.714872 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-4b5518ca-711d-4045-a507-e1e5ea5ec419 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] 10.222.0.57 "GET /compute/v2.1/servers/7d480b17-8874-4183-a7ec-3eed3d6bbb1b" status: 200 len: 1318 microversion: 2.1 time: 0.276885 Jun 30 12:38:08.715729 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 269/551] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:38:08 2022] GET /compute/v2.1/servers/7d480b17-8874-4183-a7ec-3eed3d6bbb1b => generated 1318 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:38:08.860535 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-488dc90e-3b2d-4e65-a343-53373007e9b2 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:08.861467 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-488dc90e-3b2d-4e65-a343-53373007e9b2 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 973c1877-9855-432d-819a-cdfcc917d844] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:08.869624 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-488dc90e-3b2d-4e65-a343-53373007e9b2 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:08.870714 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-488dc90e-3b2d-4e65-a343-53373007e9b2 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:08.871946 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-488dc90e-3b2d-4e65-a343-53373007e9b2 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:08.872613 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-488dc90e-3b2d-4e65-a343-53373007e9b2 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:08.952992 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-488dc90e-3b2d-4e65-a343-53373007e9b2 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddb38b4d6864a6c96b84c9a4092eea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60d10dba1d947cc97149a063a810129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:38:08.961830 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-488dc90e-3b2d-4e65-a343-53373007e9b2 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/973c1877-9855-432d-819a-cdfcc917d844" status: 200 len: 1288 microversion: 2.1 time: 0.105521 Jun 30 12:38:08.962986 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 283/552] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:38:08 2022] GET /compute/v2.1/servers/973c1877-9855-432d-819a-cdfcc917d844 => generated 1288 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:38:09.678088 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [req-a270ebb9-f882-4e13-94ea-9e3a8eb6ad79 req-3aa76227-98c3-4359-9837-0260152bc2b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d480b17-8874-4183-a7ec-3eed3d6bbb1b", "name": "network-vif-plugged", "status": "completed", "tag": "2d091604-c7cf-4cf1-a44d-5310eae90174"}]} {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:38:09.687237 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [req-a270ebb9-f882-4e13-94ea-9e3a8eb6ad79 req-3aa76227-98c3-4359-9837-0260152bc2b8 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:09.687693 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [req-a270ebb9-f882-4e13-94ea-9e3a8eb6ad79 req-3aa76227-98c3-4359-9837-0260152bc2b8 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:09.700597 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.compute.server_external_events [req-a270ebb9-f882-4e13-94ea-9e3a8eb6ad79 req-3aa76227-98c3-4359-9837-0260152bc2b8 service nova] Creating event network-vif-plugged:2d091604-c7cf-4cf1-a44d-5310eae90174 for instance 7d480b17-8874-4183-a7ec-3eed3d6bbb1b on hv-cinder-84614 Jun 30 12:38:09.706607 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [req-a270ebb9-f882-4e13-94ea-9e3a8eb6ad79 req-3aa76227-98c3-4359-9837-0260152bc2b8 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032438 Jun 30 12:38:09.707895 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 270/553] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 30 12:38:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:38:09.731681 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-581fe560-e621-469c-b51a-36c4d441ceb8 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:09.732445 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-581fe560-e621-469c-b51a-36c4d441ceb8 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] [instance: 7d480b17-8874-4183-a7ec-3eed3d6bbb1b] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:09.739680 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-581fe560-e621-469c-b51a-36c4d441ceb8 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:09.740990 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-581fe560-e621-469c-b51a-36c4d441ceb8 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:09.746222 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-581fe560-e621-469c-b51a-36c4d441ceb8 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:09.746952 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-581fe560-e621-469c-b51a-36c4d441ceb8 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:09.980779 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-c9b470cd-adcc-4c16-884d-1fd0d74b4162 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:09.981775 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-c9b470cd-adcc-4c16-884d-1fd0d74b4162 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 973c1877-9855-432d-819a-cdfcc917d844] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:09.991325 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-c9b470cd-adcc-4c16-884d-1fd0d74b4162 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:09.991783 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-c9b470cd-adcc-4c16-884d-1fd0d74b4162 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:09.992614 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-c9b470cd-adcc-4c16-884d-1fd0d74b4162 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:09.993347 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-c9b470cd-adcc-4c16-884d-1fd0d74b4162 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:10.100751 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-581fe560-e621-469c-b51a-36c4d441ceb8 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdc0eeb6cd443d78aefefca488d8c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3eabfe3692b44d8ae5f7d137ce1d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:38:10.107874 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-c9b470cd-adcc-4c16-884d-1fd0d74b4162 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddb38b4d6864a6c96b84c9a4092eea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60d10dba1d947cc97149a063a810129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:38:10.109289 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-581fe560-e621-469c-b51a-36c4d441ceb8 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] 10.222.0.57 "GET /compute/v2.1/servers/7d480b17-8874-4183-a7ec-3eed3d6bbb1b" status: 200 len: 1318 microversion: 2.1 time: 0.381499 Jun 30 12:38:10.110428 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 284/554] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:38:09 2022] GET /compute/v2.1/servers/7d480b17-8874-4183-a7ec-3eed3d6bbb1b => generated 1318 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:38:10.117302 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-c9b470cd-adcc-4c16-884d-1fd0d74b4162 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/973c1877-9855-432d-819a-cdfcc917d844" status: 200 len: 1294 microversion: 2.1 time: 0.141272 Jun 30 12:38:10.118459 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 271/555] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:38:09 2022] GET /compute/v2.1/servers/973c1877-9855-432d-819a-cdfcc917d844 => generated 1294 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 12:38:10.788981 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-d843554a-bcbe-406c-92e3-50a217ae282f tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:10.789481 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-d843554a-bcbe-406c-92e3-50a217ae282f tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: 7f35d48f-59b1-4105-a9ea-a6ffee1b86d0] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:10.802660 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-d843554a-bcbe-406c-92e3-50a217ae282f tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:10.803249 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-d843554a-bcbe-406c-92e3-50a217ae282f tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:10.804058 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-d843554a-bcbe-406c-92e3-50a217ae282f tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:10.804739 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-d843554a-bcbe-406c-92e3-50a217ae282f tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:10.902589 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.objects.instance [None req-d843554a-bcbe-406c-92e3-50a217ae282f tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lazy-loading 'services' on Instance uuid 7f35d48f-59b1-4105-a9ea-a6ffee1b86d0 {{(pid=124297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 12:38:10.976919 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-d843554a-bcbe-406c-92e3-50a217ae282f tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "DELETE /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0/os-volume_attachments/944feb9e-e424-4f80-979c-b821a2c9bde6" status: 202 len: 0 microversion: 2.1 time: 0.192887 Jun 30 12:38:10.977526 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 285/556] 10.222.0.57 () {58 vars in 1415 bytes} [Thu Jun 30 12:38:10 2022] DELETE /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0/os-volume_attachments/944feb9e-e424-4f80-979c-b821a2c9bde6 => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 12:38:10.986619 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-196c2bf5-7714-4a50-a0b5-dcc443584edb tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:10.987562 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-196c2bf5-7714-4a50-a0b5-dcc443584edb tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: 7f35d48f-59b1-4105-a9ea-a6ffee1b86d0] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:10.994078 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-196c2bf5-7714-4a50-a0b5-dcc443584edb tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:10.994527 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-196c2bf5-7714-4a50-a0b5-dcc443584edb tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:10.995547 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-196c2bf5-7714-4a50-a0b5-dcc443584edb tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:10.995990 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-196c2bf5-7714-4a50-a0b5-dcc443584edb tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:11.035412 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-196c2bf5-7714-4a50-a0b5-dcc443584edb tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052966 Jun 30 12:38:11.037196 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 272/557] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jun 30 12:38:10 2022] GET /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:38:11.128399 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-458707f6-4f25-4529-bb83-fe32d5edd09b tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:11.130128 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-458707f6-4f25-4529-bb83-fe32d5edd09b tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] [instance: 7d480b17-8874-4183-a7ec-3eed3d6bbb1b] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:11.137694 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-458707f6-4f25-4529-bb83-fe32d5edd09b tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:11.138225 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-342adde8-749a-40da-a8e1-ec42483de3ee tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:11.138596 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-458707f6-4f25-4529-bb83-fe32d5edd09b tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:11.138841 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-342adde8-749a-40da-a8e1-ec42483de3ee tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 973c1877-9855-432d-819a-cdfcc917d844] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:11.139714 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-458707f6-4f25-4529-bb83-fe32d5edd09b tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:11.140310 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-458707f6-4f25-4529-bb83-fe32d5edd09b tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:11.148989 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-342adde8-749a-40da-a8e1-ec42483de3ee tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:11.149434 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-342adde8-749a-40da-a8e1-ec42483de3ee tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:11.151228 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-342adde8-749a-40da-a8e1-ec42483de3ee tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:11.152347 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-342adde8-749a-40da-a8e1-ec42483de3ee tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:11.541099 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-458707f6-4f25-4529-bb83-fe32d5edd09b tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdc0eeb6cd443d78aefefca488d8c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3eabfe3692b44d8ae5f7d137ce1d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:38:11.543696 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-342adde8-749a-40da-a8e1-ec42483de3ee tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddb38b4d6864a6c96b84c9a4092eea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60d10dba1d947cc97149a063a810129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:38:11.550143 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-458707f6-4f25-4529-bb83-fe32d5edd09b tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] 10.222.0.57 "GET /compute/v2.1/servers/7d480b17-8874-4183-a7ec-3eed3d6bbb1b" status: 200 len: 1318 microversion: 2.1 time: 0.426329 Jun 30 12:38:11.551415 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 286/558] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:38:11 2022] GET /compute/v2.1/servers/7d480b17-8874-4183-a7ec-3eed3d6bbb1b => generated 1318 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:38:11.558904 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-342adde8-749a-40da-a8e1-ec42483de3ee tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/973c1877-9855-432d-819a-cdfcc917d844" status: 200 len: 1361 microversion: 2.1 time: 0.427149 Jun 30 12:38:11.559881 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 273/559] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:38:11 2022] GET /compute/v2.1/servers/973c1877-9855-432d-819a-cdfcc917d844 => generated 1361 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:38:12.048581 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-85722868-984e-40ef-9879-0da667687ede tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:12.049655 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-85722868-984e-40ef-9879-0da667687ede tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: 7f35d48f-59b1-4105-a9ea-a6ffee1b86d0] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:12.053472 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG dbcounter [-] [124297] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=3 {{(pid=124297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:12.058816 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-85722868-984e-40ef-9879-0da667687ede tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:12.059809 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-85722868-984e-40ef-9879-0da667687ede tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:12.060205 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-85722868-984e-40ef-9879-0da667687ede tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:12.060654 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-85722868-984e-40ef-9879-0da667687ede tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:12.093892 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-85722868-984e-40ef-9879-0da667687ede tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050200 Jun 30 12:38:12.094504 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 287/560] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jun 30 12:38:12 2022] GET /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:38:12.148519 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [req-52dff96e-994c-4de1-9289-8383ea3cfcf5 req-91bb6384-ac36-413a-9366-67a8f73a741c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "973c1877-9855-432d-819a-cdfcc917d844", "tag": "aaa72124-a7b1-4c09-844d-d0fffd8ed459"}]} {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:38:12.162891 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [req-52dff96e-994c-4de1-9289-8383ea3cfcf5 req-91bb6384-ac36-413a-9366-67a8f73a741c service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:12.163954 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [req-52dff96e-994c-4de1-9289-8383ea3cfcf5 req-91bb6384-ac36-413a-9366-67a8f73a741c service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:12.187857 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.compute.server_external_events [req-52dff96e-994c-4de1-9289-8383ea3cfcf5 req-91bb6384-ac36-413a-9366-67a8f73a741c service nova] Creating event network-changed:aaa72124-a7b1-4c09-844d-d0fffd8ed459 for instance 973c1877-9855-432d-819a-cdfcc917d844 on hv-cinder-84614 Jun 30 12:38:12.193259 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [req-52dff96e-994c-4de1-9289-8383ea3cfcf5 req-91bb6384-ac36-413a-9366-67a8f73a741c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050546 Jun 30 12:38:12.194073 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 274/561] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 30 12:38:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 12:38:12.569315 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-6fc7c8d8-be3d-41f8-8ee6-441d2c778411 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:12.570555 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-6fc7c8d8-be3d-41f8-8ee6-441d2c778411 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] [instance: 7d480b17-8874-4183-a7ec-3eed3d6bbb1b] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:12.576815 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-6fc7c8d8-be3d-41f8-8ee6-441d2c778411 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:12.577470 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-6fc7c8d8-be3d-41f8-8ee6-441d2c778411 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:12.578510 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-6fc7c8d8-be3d-41f8-8ee6-441d2c778411 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:12.579882 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-6fc7c8d8-be3d-41f8-8ee6-441d2c778411 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:12.582107 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-e64e8cf4-232d-4ecd-ab1b-caa2fa58ac57 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:12.583142 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-e64e8cf4-232d-4ecd-ab1b-caa2fa58ac57 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 973c1877-9855-432d-819a-cdfcc917d844] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:12.591937 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-e64e8cf4-232d-4ecd-ab1b-caa2fa58ac57 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:12.592672 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-e64e8cf4-232d-4ecd-ab1b-caa2fa58ac57 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:12.593710 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-e64e8cf4-232d-4ecd-ab1b-caa2fa58ac57 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:12.594287 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-e64e8cf4-232d-4ecd-ab1b-caa2fa58ac57 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:13.198656 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-6fc7c8d8-be3d-41f8-8ee6-441d2c778411 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdc0eeb6cd443d78aefefca488d8c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3eabfe3692b44d8ae5f7d137ce1d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:38:13.206673 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-6fc7c8d8-be3d-41f8-8ee6-441d2c778411 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] 10.222.0.57 "GET /compute/v2.1/servers/7d480b17-8874-4183-a7ec-3eed3d6bbb1b" status: 200 len: 1507 microversion: 2.1 time: 0.641118 Jun 30 12:38:13.207459 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 288/562] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:38:12 2022] GET /compute/v2.1/servers/7d480b17-8874-4183-a7ec-3eed3d6bbb1b => generated 1507 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:38:13.212209 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-8e5bb43d-b361-4890-a5b4-8b71a15820d2 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:13.213166 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-8e5bb43d-b361-4890-a5b4-8b71a15820d2 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: 7f35d48f-59b1-4105-a9ea-a6ffee1b86d0] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:13.220000 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-8e5bb43d-b361-4890-a5b4-8b71a15820d2 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:13.220453 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-8e5bb43d-b361-4890-a5b4-8b71a15820d2 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:13.221261 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-8e5bb43d-b361-4890-a5b4-8b71a15820d2 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:13.221696 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-8e5bb43d-b361-4890-a5b4-8b71a15820d2 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:13.254038 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-8e5bb43d-b361-4890-a5b4-8b71a15820d2 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045497 Jun 30 12:38:13.254605 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 289/563] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jun 30 12:38:13 2022] GET /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 30 12:38:13.260112 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-bd7c4504-e1ad-4572-9958-6bb64efdb9ce tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "59f41819-d944-48da-8aec-c74716987716", "device": "/dev/sdb"}} {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:38:13.260712 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-bd7c4504-e1ad-4572-9958-6bb64efdb9ce tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] [instance: 7d480b17-8874-4183-a7ec-3eed3d6bbb1b] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:13.266991 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-bd7c4504-e1ad-4572-9958-6bb64efdb9ce tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:13.267441 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-bd7c4504-e1ad-4572-9958-6bb64efdb9ce tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:13.268279 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-bd7c4504-e1ad-4572-9958-6bb64efdb9ce tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:13.268658 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-bd7c4504-e1ad-4572-9958-6bb64efdb9ce tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:13.290416 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-e64e8cf4-232d-4ecd-ab1b-caa2fa58ac57 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddb38b4d6864a6c96b84c9a4092eea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60d10dba1d947cc97149a063a810129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:38:13.321918 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-e64e8cf4-232d-4ecd-ab1b-caa2fa58ac57 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/973c1877-9855-432d-819a-cdfcc917d844" status: 200 len: 1361 microversion: 2.1 time: 0.744717 Jun 30 12:38:13.325879 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 275/564] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:38:12 2022] GET /compute/v2.1/servers/973c1877-9855-432d-819a-cdfcc917d844 => generated 1361 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:38:13.331367 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-15d989e7-c2c2-4166-b8db-bc142fd8fdcf tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:13.331868 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-15d989e7-c2c2-4166-b8db-bc142fd8fdcf tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: 7f35d48f-59b1-4105-a9ea-a6ffee1b86d0] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:13.339005 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-15d989e7-c2c2-4166-b8db-bc142fd8fdcf tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:13.339455 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-15d989e7-c2c2-4166-b8db-bc142fd8fdcf tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:13.340279 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-15d989e7-c2c2-4166-b8db-bc142fd8fdcf tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:13.340743 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-15d989e7-c2c2-4166-b8db-bc142fd8fdcf tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:13.370464 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-15d989e7-c2c2-4166-b8db-bc142fd8fdcf tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: 7f35d48f-59b1-4105-a9ea-a6ffee1b86d0] Going to try to terminate instance {{(pid=124298) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 12:38:13.482877 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-15d989e7-c2c2-4166-b8db-bc142fd8fdcf tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "DELETE /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0" status: 204 len: 0 microversion: 2.1 time: 0.155459 Jun 30 12:38:13.484712 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 276/565] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 30 12:38:13 2022] DELETE /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 12:38:13.493047 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-965324a7-cdc7-40b3-8cfc-983cab85875c tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:13.493798 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-965324a7-cdc7-40b3-8cfc-983cab85875c tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: 7f35d48f-59b1-4105-a9ea-a6ffee1b86d0] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:13.500074 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-965324a7-cdc7-40b3-8cfc-983cab85875c tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:13.500606 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-965324a7-cdc7-40b3-8cfc-983cab85875c tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:13.501595 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-965324a7-cdc7-40b3-8cfc-983cab85875c tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:13.502250 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-965324a7-cdc7-40b3-8cfc-983cab85875c tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:13.559763 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-bd7c4504-e1ad-4572-9958-6bb64efdb9ce tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] 10.222.0.57 "POST /compute/v2.1/servers/7d480b17-8874-4183-a7ec-3eed3d6bbb1b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.303946 Jun 30 12:38:13.560599 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 290/566] 10.222.0.57 () {60 vars in 1322 bytes} [Thu Jun 30 12:38:13 2022] POST /compute/v2.1/servers/7d480b17-8874-4183-a7ec-3eed3d6bbb1b/os-volume_attachments => generated 194 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:38:13.733992 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-965324a7-cdc7-40b3-8cfc-983cab85875c tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:38:13.742456 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-965324a7-cdc7-40b3-8cfc-983cab85875c tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0" status: 200 len: 1688 microversion: 2.1 time: 0.254298 Jun 30 12:38:13.743236 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 277/567] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:38:13 2022] GET /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0 => generated 1688 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:38:14.353785 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-5640ac45-8fc1-4db8-9661-d64f32b74f64 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:14.357346 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-5640ac45-8fc1-4db8-9661-d64f32b74f64 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 973c1877-9855-432d-819a-cdfcc917d844] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:14.367995 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-5640ac45-8fc1-4db8-9661-d64f32b74f64 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:14.368422 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-5640ac45-8fc1-4db8-9661-d64f32b74f64 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:14.369960 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-5640ac45-8fc1-4db8-9661-d64f32b74f64 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:14.370553 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-5640ac45-8fc1-4db8-9661-d64f32b74f64 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:14.507181 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-5640ac45-8fc1-4db8-9661-d64f32b74f64 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddb38b4d6864a6c96b84c9a4092eea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60d10dba1d947cc97149a063a810129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:38:14.510977 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG dbcounter [-] [124297] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=124297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:14.516370 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-5640ac45-8fc1-4db8-9661-d64f32b74f64 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/973c1877-9855-432d-819a-cdfcc917d844" status: 200 len: 1361 microversion: 2.1 time: 0.176011 Jun 30 12:38:14.516953 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 291/568] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:38:14 2022] GET /compute/v2.1/servers/973c1877-9855-432d-819a-cdfcc917d844 => generated 1361 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:38:14.759521 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-4a5e672b-2082-43cf-9ebd-9daabf71a4c2 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:14.760317 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-4a5e672b-2082-43cf-9ebd-9daabf71a4c2 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: 7f35d48f-59b1-4105-a9ea-a6ffee1b86d0] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:14.767272 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-4a5e672b-2082-43cf-9ebd-9daabf71a4c2 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:14.767820 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-4a5e672b-2082-43cf-9ebd-9daabf71a4c2 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:14.768660 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-4a5e672b-2082-43cf-9ebd-9daabf71a4c2 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:14.769187 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-4a5e672b-2082-43cf-9ebd-9daabf71a4c2 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:14.788651 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG dbcounter [-] [124298] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:14.951583 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-4a5e672b-2082-43cf-9ebd-9daabf71a4c2 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:38:14.960158 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-4a5e672b-2082-43cf-9ebd-9daabf71a4c2 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0" status: 200 len: 1688 microversion: 2.1 time: 0.204495 Jun 30 12:38:14.960782 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 278/569] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:38:14 2022] GET /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0 => generated 1688 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:38:15.534619 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-cc2b2c6a-f75b-433c-ba22-40bbddfbdfdc tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:15.535200 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-cc2b2c6a-f75b-433c-ba22-40bbddfbdfdc tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 973c1877-9855-432d-819a-cdfcc917d844] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:15.544187 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-cc2b2c6a-f75b-433c-ba22-40bbddfbdfdc tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:15.544652 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-cc2b2c6a-f75b-433c-ba22-40bbddfbdfdc tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:15.545431 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-cc2b2c6a-f75b-433c-ba22-40bbddfbdfdc tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:15.545847 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-cc2b2c6a-f75b-433c-ba22-40bbddfbdfdc tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:15.698720 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-cc2b2c6a-f75b-433c-ba22-40bbddfbdfdc tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddb38b4d6864a6c96b84c9a4092eea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60d10dba1d947cc97149a063a810129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:38:15.712592 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-cc2b2c6a-f75b-433c-ba22-40bbddfbdfdc tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/973c1877-9855-432d-819a-cdfcc917d844" status: 200 len: 1361 microversion: 2.1 time: 0.182824 Jun 30 12:38:15.713335 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 292/570] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:38:15 2022] GET /compute/v2.1/servers/973c1877-9855-432d-819a-cdfcc917d844 => generated 1361 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:38:15.977635 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-c87b44a1-1208-4bdb-8668-d452c9103916 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:15.978202 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-c87b44a1-1208-4bdb-8668-d452c9103916 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: 7f35d48f-59b1-4105-a9ea-a6ffee1b86d0] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:15.985726 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-c87b44a1-1208-4bdb-8668-d452c9103916 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:15.986348 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-c87b44a1-1208-4bdb-8668-d452c9103916 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:15.987122 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-c87b44a1-1208-4bdb-8668-d452c9103916 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:15.987557 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-c87b44a1-1208-4bdb-8668-d452c9103916 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:16.132304 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-c87b44a1-1208-4bdb-8668-d452c9103916 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:38:16.140429 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-c87b44a1-1208-4bdb-8668-d452c9103916 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0" status: 200 len: 1688 microversion: 2.1 time: 0.166689 Jun 30 12:38:16.141129 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 279/571] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:38:15 2022] GET /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0 => generated 1688 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:38:16.731014 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-73c194a2-f404-45fc-ab36-ad1de6251cef tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:16.731976 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-73c194a2-f404-45fc-ab36-ad1de6251cef tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 973c1877-9855-432d-819a-cdfcc917d844] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:16.740211 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-73c194a2-f404-45fc-ab36-ad1de6251cef tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:16.740685 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-73c194a2-f404-45fc-ab36-ad1de6251cef tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:16.741476 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-73c194a2-f404-45fc-ab36-ad1de6251cef tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:16.741912 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-73c194a2-f404-45fc-ab36-ad1de6251cef tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:16.893272 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-73c194a2-f404-45fc-ab36-ad1de6251cef tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddb38b4d6864a6c96b84c9a4092eea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60d10dba1d947cc97149a063a810129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:38:16.901495 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-73c194a2-f404-45fc-ab36-ad1de6251cef tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/973c1877-9855-432d-819a-cdfcc917d844" status: 200 len: 1361 microversion: 2.1 time: 0.174895 Jun 30 12:38:16.902068 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 293/572] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:38:16 2022] GET /compute/v2.1/servers/973c1877-9855-432d-819a-cdfcc917d844 => generated 1361 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:38:17.162774 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-4031ae00-6986-41fd-9ec2-6f256fef5367 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:17.163638 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-4031ae00-6986-41fd-9ec2-6f256fef5367 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: 7f35d48f-59b1-4105-a9ea-a6ffee1b86d0] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:17.175246 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-4031ae00-6986-41fd-9ec2-6f256fef5367 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:17.176486 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-4031ae00-6986-41fd-9ec2-6f256fef5367 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:17.177871 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-4031ae00-6986-41fd-9ec2-6f256fef5367 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:17.178668 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-4031ae00-6986-41fd-9ec2-6f256fef5367 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:17.439758 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-4031ae00-6986-41fd-9ec2-6f256fef5367 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:38:17.448095 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-4031ae00-6986-41fd-9ec2-6f256fef5367 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0" status: 200 len: 1688 microversion: 2.1 time: 0.292508 Jun 30 12:38:17.448689 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 280/573] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:38:17 2022] GET /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0 => generated 1688 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:38:17.919521 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-4a89a794-36be-4bb8-9f8f-bd1b1520e78f tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:17.920510 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-4a89a794-36be-4bb8-9f8f-bd1b1520e78f tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 973c1877-9855-432d-819a-cdfcc917d844] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:17.929068 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG dbcounter [-] [124297] Writing DB stats nova_cell0:SELECT=2 {{(pid=124297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:17.931984 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-4a89a794-36be-4bb8-9f8f-bd1b1520e78f tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:17.932729 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-4a89a794-36be-4bb8-9f8f-bd1b1520e78f tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:17.933522 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-4a89a794-36be-4bb8-9f8f-bd1b1520e78f tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:17.934163 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-4a89a794-36be-4bb8-9f8f-bd1b1520e78f tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:18.080819 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-4a89a794-36be-4bb8-9f8f-bd1b1520e78f tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddb38b4d6864a6c96b84c9a4092eea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60d10dba1d947cc97149a063a810129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:38:18.088553 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-4a89a794-36be-4bb8-9f8f-bd1b1520e78f tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/973c1877-9855-432d-819a-cdfcc917d844" status: 200 len: 1361 microversion: 2.1 time: 0.172983 Jun 30 12:38:18.089151 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 294/574] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:38:17 2022] GET /compute/v2.1/servers/973c1877-9855-432d-819a-cdfcc917d844 => generated 1361 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:38:18.466635 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-fea5dcf4-4968-4263-b170-319836924ac4 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:18.467736 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-fea5dcf4-4968-4263-b170-319836924ac4 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: 7f35d48f-59b1-4105-a9ea-a6ffee1b86d0] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:18.470451 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG dbcounter [-] [124298] Writing DB stats nova_cell0:SELECT=2 {{(pid=124298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:18.470451 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG dbcounter [-] [124298] Writing DB stats nova_cell0:SELECT=12 {{(pid=124298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:18.479673 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-fea5dcf4-4968-4263-b170-319836924ac4 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:18.480174 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-fea5dcf4-4968-4263-b170-319836924ac4 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:18.481479 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-fea5dcf4-4968-4263-b170-319836924ac4 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:18.482081 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-fea5dcf4-4968-4263-b170-319836924ac4 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:18.519948 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [req-45e7ae39-e782-4d94-9bdf-91184b117957 req-2338e40d-40cd-4d0e-819e-66325d2f7426 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f35d48f-59b1-4105-a9ea-a6ffee1b86d0", "name": "network-vif-deleted", "tag": "429c2df1-f159-4a74-afc7-610947f53fa7"}]} {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:38:18.528790 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [req-45e7ae39-e782-4d94-9bdf-91184b117957 req-2338e40d-40cd-4d0e-819e-66325d2f7426 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:18.529255 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [req-45e7ae39-e782-4d94-9bdf-91184b117957 req-2338e40d-40cd-4d0e-819e-66325d2f7426 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:18.547800 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-fea5dcf4-4968-4263-b170-319836924ac4 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:38:18.554346 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.compute.server_external_events [req-45e7ae39-e782-4d94-9bdf-91184b117957 req-2338e40d-40cd-4d0e-819e-66325d2f7426 service nova] Creating event network-vif-deleted:429c2df1-f159-4a74-afc7-610947f53fa7 for instance 7f35d48f-59b1-4105-a9ea-a6ffee1b86d0 on hv-cinder-84614 Jun 30 12:38:18.555667 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-fea5dcf4-4968-4263-b170-319836924ac4 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0" status: 200 len: 1620 microversion: 2.1 time: 0.093768 Jun 30 12:38:18.556491 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 281/575] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:38:18 2022] GET /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0 => generated 1620 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:38:18.569058 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [req-45e7ae39-e782-4d94-9bdf-91184b117957 req-2338e40d-40cd-4d0e-819e-66325d2f7426 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052852 Jun 30 12:38:18.570084 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 295/576] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 30 12:38:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 12:38:19.106907 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-feccefa5-b4d5-4153-9094-d457b9d67543 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:19.107792 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-feccefa5-b4d5-4153-9094-d457b9d67543 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 973c1877-9855-432d-819a-cdfcc917d844] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:19.116682 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-feccefa5-b4d5-4153-9094-d457b9d67543 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:19.117485 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-feccefa5-b4d5-4153-9094-d457b9d67543 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:19.118279 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-feccefa5-b4d5-4153-9094-d457b9d67543 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:19.118718 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-feccefa5-b4d5-4153-9094-d457b9d67543 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:19.260897 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-feccefa5-b4d5-4153-9094-d457b9d67543 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddb38b4d6864a6c96b84c9a4092eea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60d10dba1d947cc97149a063a810129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:38:19.268454 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-feccefa5-b4d5-4153-9094-d457b9d67543 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/973c1877-9855-432d-819a-cdfcc917d844" status: 200 len: 1361 microversion: 2.1 time: 0.166740 Jun 30 12:38:19.269081 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 282/577] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:38:19 2022] GET /compute/v2.1/servers/973c1877-9855-432d-819a-cdfcc917d844 => generated 1361 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:38:19.576129 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-4db79a53-c105-45b2-9ae8-cbaae0d62e69 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:19.577046 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-4db79a53-c105-45b2-9ae8-cbaae0d62e69 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: 7f35d48f-59b1-4105-a9ea-a6ffee1b86d0] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:19.584828 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-4db79a53-c105-45b2-9ae8-cbaae0d62e69 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:19.585717 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-4db79a53-c105-45b2-9ae8-cbaae0d62e69 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:19.586813 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-4db79a53-c105-45b2-9ae8-cbaae0d62e69 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:19.587611 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-4db79a53-c105-45b2-9ae8-cbaae0d62e69 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:19.603622 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.wsgi [None req-4db79a53-c105-45b2-9ae8-cbaae0d62e69 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] HTTP exception thrown: Instance 7f35d48f-59b1-4105-a9ea-a6ffee1b86d0 could not be found. Jun 30 12:38:19.605580 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-4db79a53-c105-45b2-9ae8-cbaae0d62e69 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Request method failure captured: Jun 30 12:38:19.605580 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: request: GET /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0 HTTP/1.1 Jun 30 12:38:19.605580 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Accept: application/json Jun 30 12:38:19.605580 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Accept-Encoding: identity Jun 30 12:38:19.605580 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Connection: close Jun 30 12:38:19.605580 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Content-Length: 0 Jun 30 12:38:19.605580 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Content-Type: application/json Jun 30 12:38:19.605580 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Host: 10.222.0.57 Jun 30 12:38:19.605580 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Openstack-System-Scope: None Jun 30 12:38:19.605580 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: User-Agent: python-urllib3/1.26.9 Jun 30 12:38:19.605580 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Auth-Token: gAAAAABivZf_BQGmfS0HOoL_I4T5VOYxBuxZGY2QWD4EHtWbjr8O76qqmYfKKC4FlZ72eOwJFTdgHeD24bmk91RgL5Xpb2Vmu8gdl5stiFwB3gOIKDDDppLMeT3KoEQDYGRtO6bS_AC7MydPE6Kd2zAsainH0ZDMCZDu5MtfqV2V5srDhTVvC8U Jun 30 12:38:19.605580 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Domain-Id: None Jun 30 12:38:19.605580 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Domain-Name: None Jun 30 12:38:19.605580 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Identity-Status: Confirmed Jun 30 12:38:19.605580 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Is-Admin-Project: True Jun 30 12:38:19.605580 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Project-Domain-Id: default Jun 30 12:38:19.605580 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Project-Domain-Name: Default Jun 30 12:38:19.605580 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Project-Id: 663ec7a59bc147299f904d93d119c5e7 Jun 30 12:38:19.605580 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1641653126 Jun 30 12:38:19.605580 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Role: member,reader Jun 30 12:38:19.605580 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Roles: member,reader Jun 30 12:38:19.606940 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/663ec7a59bc147299f904d93d119c5e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/663ec7a59bc147299f904d93d119c5e7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_663ec7a59bc147299f904d93d119c5e7", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/663ec7a59bc147299f904d93d119c5e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 30 12:38:19.606940 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1641653126 Jun 30 12:38:19.606940 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Tenant-Id: 663ec7a59bc147299f904d93d119c5e7 Jun 30 12:38:19.606940 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1641653126 Jun 30 12:38:19.606940 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User: tempest-ServerRescueNegativeTestJSON-1641653126-project Jun 30 12:38:19.606940 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User-Domain-Id: default Jun 30 12:38:19.606940 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User-Domain-Name: Default Jun 30 12:38:19.606940 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User-Id: 26807e5e7aab425eb28e781289794265 Jun 30 12:38:19.606940 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1641653126-project Jun 30 12:38:19.606940 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: method: > Jun 30 12:38:19.606940 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: exception: Instance 7f35d48f-59b1-4105-a9ea-a6ffee1b86d0 could not be found. Jun 30 12:38:19.606940 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: action_args: {'id': '7f35d48f-59b1-4105-a9ea-a6ffee1b86d0'} Jun 30 12:38:19.607843 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 12:38:19.607843 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:38:19.607843 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 12:38:19.607843 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 12:38:19.607843 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 12:38:19.607843 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 12:38:19.607843 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 12:38:19.607843 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 12:38:19.607843 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 12:38:19.607843 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 12:38:19.607843 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f35d48f-59b1-4105-a9ea-a6ffee1b86d0 could not be found. Jun 30 12:38:19.607843 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:38:19.607843 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:38:19.607843 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:38:19.607843 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:38:19.607843 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:38:19.607843 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:38:19.607843 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 12:38:19.607843 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 12:38:19.607843 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 12:38:19.609451 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 12:38:19.609451 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 12:38:19.609451 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 12:38:19.609451 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 12:38:19.609451 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 12:38:19.609451 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 12:38:19.609451 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 12:38:19.609451 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f35d48f-59b1-4105-a9ea-a6ffee1b86d0 could not be found. Jun 30 12:38:19.609451 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:38:19.609451 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:38:19.609451 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:38:19.609451 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:38:19.609451 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:38:19.609451 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:38:19.609451 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 12:38:19.609451 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 12:38:19.609451 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f35d48f-59b1-4105-a9ea-a6ffee1b86d0 could not be found. Jun 30 12:38:19.609451 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:38:19.610785 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-4db79a53-c105-45b2-9ae8-cbaae0d62e69 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Returning 404 to user: Instance 7f35d48f-59b1-4105-a9ea-a6ffee1b86d0 could not be found. {{(pid=124297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 12:38:19.610785 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-4db79a53-c105-45b2-9ae8-cbaae0d62e69 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0" status: 404 len: 111 microversion: 2.1 time: 0.035931 Jun 30 12:38:19.611293 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 296/578] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:38:19 2022] GET /compute/v2.1/servers/7f35d48f-59b1-4105-a9ea-a6ffee1b86d0 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 12:38:19.616089 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-58cbc0b3-7dfe-41ca-a500-fb261c47f9c9 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '.version_select at 0x7fd0e015f9d0>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:19.639087 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-58cbc0b3-7dfe-41ca-a500-fb261c47f9c9 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-903132750" status: 202 len: 0 microversion: 2.1 time: 0.027026 Jun 30 12:38:19.639674 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 283/579] 10.222.0.57 () {58 vars in 1217 bytes} [Thu Jun 30 12:38:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-903132750 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 12:38:19.772196 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [req-1217f50f-6f79-43eb-863d-899d7661e58f req-94cb7658-aa04-49b4-9b37-165d3cf343dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "973c1877-9855-432d-819a-cdfcc917d844", "name": "network-vif-plugged", "status": "completed", "tag": "aaa72124-a7b1-4c09-844d-d0fffd8ed459"}]} {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:38:19.781830 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [req-1217f50f-6f79-43eb-863d-899d7661e58f req-94cb7658-aa04-49b4-9b37-165d3cf343dd service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:19.782534 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [req-1217f50f-6f79-43eb-863d-899d7661e58f req-94cb7658-aa04-49b4-9b37-165d3cf343dd service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:19.806137 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.compute.server_external_events [req-1217f50f-6f79-43eb-863d-899d7661e58f req-94cb7658-aa04-49b4-9b37-165d3cf343dd service nova] Creating event network-vif-plugged:aaa72124-a7b1-4c09-844d-d0fffd8ed459 for instance 973c1877-9855-432d-819a-cdfcc917d844 on hv-cinder-84614 Jun 30 12:38:19.811032 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [req-1217f50f-6f79-43eb-863d-899d7661e58f req-94cb7658-aa04-49b4-9b37-165d3cf343dd service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042787 Jun 30 12:38:19.811790 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 297/580] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 30 12:38:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:38:20.286730 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-1fafddf5-cad5-4b3b-a0c1-0c8033f58928 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:20.287093 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-1fafddf5-cad5-4b3b-a0c1-0c8033f58928 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 973c1877-9855-432d-819a-cdfcc917d844] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:20.293411 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-1fafddf5-cad5-4b3b-a0c1-0c8033f58928 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:20.293959 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-1fafddf5-cad5-4b3b-a0c1-0c8033f58928 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:20.294837 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-1fafddf5-cad5-4b3b-a0c1-0c8033f58928 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:20.295334 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-1fafddf5-cad5-4b3b-a0c1-0c8033f58928 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:20.439466 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-1fafddf5-cad5-4b3b-a0c1-0c8033f58928 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddb38b4d6864a6c96b84c9a4092eea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60d10dba1d947cc97149a063a810129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:38:20.447179 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-1fafddf5-cad5-4b3b-a0c1-0c8033f58928 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/973c1877-9855-432d-819a-cdfcc917d844" status: 200 len: 1361 microversion: 2.1 time: 0.165475 Jun 30 12:38:20.447741 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 284/581] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:38:20 2022] GET /compute/v2.1/servers/973c1877-9855-432d-819a-cdfcc917d844 => generated 1361 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:38:21.466386 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-f7c9b2ec-afce-4eef-9068-00ec7460b3eb tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:21.467072 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-f7c9b2ec-afce-4eef-9068-00ec7460b3eb tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 973c1877-9855-432d-819a-cdfcc917d844] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:21.475074 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-f7c9b2ec-afce-4eef-9068-00ec7460b3eb tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:21.475739 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-f7c9b2ec-afce-4eef-9068-00ec7460b3eb tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:21.476809 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-f7c9b2ec-afce-4eef-9068-00ec7460b3eb tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:21.477386 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-f7c9b2ec-afce-4eef-9068-00ec7460b3eb tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:21.620477 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-f7c9b2ec-afce-4eef-9068-00ec7460b3eb tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddb38b4d6864a6c96b84c9a4092eea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60d10dba1d947cc97149a063a810129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:38:21.630059 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-f7c9b2ec-afce-4eef-9068-00ec7460b3eb tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/973c1877-9855-432d-819a-cdfcc917d844" status: 200 len: 1547 microversion: 2.1 time: 0.168466 Jun 30 12:38:21.630626 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 298/582] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:38:21 2022] GET /compute/v2.1/servers/973c1877-9855-432d-819a-cdfcc917d844 => generated 1547 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:38:21.646526 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-0c10f036-aa83-407e-9da2-7b895eaface2 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:21.647042 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-0c10f036-aa83-407e-9da2-7b895eaface2 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 973c1877-9855-432d-819a-cdfcc917d844] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:21.653989 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-0c10f036-aa83-407e-9da2-7b895eaface2 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:21.654432 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-0c10f036-aa83-407e-9da2-7b895eaface2 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:21.655185 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-0c10f036-aa83-407e-9da2-7b895eaface2 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:21.655617 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-0c10f036-aa83-407e-9da2-7b895eaface2 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:21.741986 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-0c10f036-aa83-407e-9da2-7b895eaface2 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/973c1877-9855-432d-819a-cdfcc917d844/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099428 Jun 30 12:38:21.742579 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 285/583] 10.222.0.57 () {58 vars in 1274 bytes} [Thu Jun 30 12:38:21 2022] GET /compute/v2.1/servers/973c1877-9855-432d-819a-cdfcc917d844/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:38:22.630781 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-0d97092b-20dd-4c32-985e-b534e41d5209 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:22.631355 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-0d97092b-20dd-4c32-985e-b534e41d5209 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: a2fe3bb8-40b2-4dea-818a-083e0bc5fb61] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:22.638242 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-0d97092b-20dd-4c32-985e-b534e41d5209 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:22.638762 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-0d97092b-20dd-4c32-985e-b534e41d5209 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:22.639502 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-0d97092b-20dd-4c32-985e-b534e41d5209 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:22.639849 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-0d97092b-20dd-4c32-985e-b534e41d5209 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:22.667119 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-0d97092b-20dd-4c32-985e-b534e41d5209 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: a2fe3bb8-40b2-4dea-818a-083e0bc5fb61] Going to try to terminate instance {{(pid=124297) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 12:38:22.684711 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [req-23c0886b-ee9e-4eff-94d3-dc0662553003 req-12e138db-bc7c-4578-8113-4cdbdb5a8421 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "973c1877-9855-432d-819a-cdfcc917d844", "tag": "aaa72124-a7b1-4c09-844d-d0fffd8ed459"}]} {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:38:22.693369 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [req-23c0886b-ee9e-4eff-94d3-dc0662553003 req-12e138db-bc7c-4578-8113-4cdbdb5a8421 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:22.693803 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [req-23c0886b-ee9e-4eff-94d3-dc0662553003 req-12e138db-bc7c-4578-8113-4cdbdb5a8421 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:22.705581 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.compute.server_external_events [req-23c0886b-ee9e-4eff-94d3-dc0662553003 req-12e138db-bc7c-4578-8113-4cdbdb5a8421 service nova] Creating event network-changed:aaa72124-a7b1-4c09-844d-d0fffd8ed459 for instance 973c1877-9855-432d-819a-cdfcc917d844 on hv-cinder-84614 Jun 30 12:38:22.711263 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [req-23c0886b-ee9e-4eff-94d3-dc0662553003 req-12e138db-bc7c-4578-8113-4cdbdb5a8421 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030742 Jun 30 12:38:22.712965 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 286/584] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 30 12:38:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 12:38:22.750842 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-0d97092b-20dd-4c32-985e-b534e41d5209 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "DELETE /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61" status: 204 len: 0 microversion: 2.1 time: 0.123465 Jun 30 12:38:22.751962 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 299/585] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 30 12:38:22 2022] DELETE /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 12:38:22.760684 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-74f0b02a-7d5a-49e4-9caf-277aca794e80 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:22.761672 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-74f0b02a-7d5a-49e4-9caf-277aca794e80 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: a2fe3bb8-40b2-4dea-818a-083e0bc5fb61] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:22.768543 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-74f0b02a-7d5a-49e4-9caf-277aca794e80 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:22.769099 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-74f0b02a-7d5a-49e4-9caf-277aca794e80 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:22.770063 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-74f0b02a-7d5a-49e4-9caf-277aca794e80 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:22.770664 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-74f0b02a-7d5a-49e4-9caf-277aca794e80 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:22.913544 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-74f0b02a-7d5a-49e4-9caf-277aca794e80 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:38:22.921295 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-74f0b02a-7d5a-49e4-9caf-277aca794e80 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61" status: 200 len: 1509 microversion: 2.1 time: 0.164959 Jun 30 12:38:22.921866 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 287/586] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:38:22 2022] GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61 => generated 1509 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:38:23.941483 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-162723b3-e6e3-4372-98a4-eb76908ca39d tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:23.942238 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-162723b3-e6e3-4372-98a4-eb76908ca39d tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: a2fe3bb8-40b2-4dea-818a-083e0bc5fb61] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:23.949761 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-162723b3-e6e3-4372-98a4-eb76908ca39d tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:23.950216 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-162723b3-e6e3-4372-98a4-eb76908ca39d tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:23.950987 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-162723b3-e6e3-4372-98a4-eb76908ca39d tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:23.951419 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-162723b3-e6e3-4372-98a4-eb76908ca39d tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:24.087746 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-162723b3-e6e3-4372-98a4-eb76908ca39d tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:38:24.095896 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-162723b3-e6e3-4372-98a4-eb76908ca39d tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61" status: 200 len: 1509 microversion: 2.1 time: 0.160276 Jun 30 12:38:24.096489 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 300/587] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:38:23 2022] GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61 => generated 1509 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:38:25.117459 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-17c69e49-570c-4970-af56-587f49d348e4 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:25.118090 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-17c69e49-570c-4970-af56-587f49d348e4 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: a2fe3bb8-40b2-4dea-818a-083e0bc5fb61] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:25.124346 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-17c69e49-570c-4970-af56-587f49d348e4 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:25.124829 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-17c69e49-570c-4970-af56-587f49d348e4 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:25.125592 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-17c69e49-570c-4970-af56-587f49d348e4 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:25.126021 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-17c69e49-570c-4970-af56-587f49d348e4 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:25.267172 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-17c69e49-570c-4970-af56-587f49d348e4 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:38:25.275006 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-17c69e49-570c-4970-af56-587f49d348e4 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61" status: 200 len: 1509 microversion: 2.1 time: 0.161384 Jun 30 12:38:25.275847 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 288/588] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:38:25 2022] GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61 => generated 1509 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:38:26.291808 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-6f2768d6-8c84-4d3c-b66d-144986a55c31 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:26.292976 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-6f2768d6-8c84-4d3c-b66d-144986a55c31 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: a2fe3bb8-40b2-4dea-818a-083e0bc5fb61] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:26.302975 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-6f2768d6-8c84-4d3c-b66d-144986a55c31 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:26.303665 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-6f2768d6-8c84-4d3c-b66d-144986a55c31 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:26.304590 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-6f2768d6-8c84-4d3c-b66d-144986a55c31 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:26.305549 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-6f2768d6-8c84-4d3c-b66d-144986a55c31 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:26.762978 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-6f2768d6-8c84-4d3c-b66d-144986a55c31 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:38:26.771470 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-6f2768d6-8c84-4d3c-b66d-144986a55c31 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61" status: 200 len: 1509 microversion: 2.1 time: 0.483432 Jun 30 12:38:26.772054 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 301/589] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:38:26 2022] GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61 => generated 1509 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 12:38:26.878190 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [req-4467ee83-08a3-4450-91d8-2c46d3ffa472 req-f60d5b87-6c3b-4b17-843e-f496462b645b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2fe3bb8-40b2-4dea-818a-083e0bc5fb61", "name": "network-vif-deleted", "tag": "7141f81e-2130-4ea4-bd66-d50c16384aaf"}]} {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:38:26.889419 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [req-4467ee83-08a3-4450-91d8-2c46d3ffa472 req-f60d5b87-6c3b-4b17-843e-f496462b645b service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:26.889854 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [req-4467ee83-08a3-4450-91d8-2c46d3ffa472 req-f60d5b87-6c3b-4b17-843e-f496462b645b service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:26.901741 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.compute.server_external_events [req-4467ee83-08a3-4450-91d8-2c46d3ffa472 req-f60d5b87-6c3b-4b17-843e-f496462b645b service nova] Creating event network-vif-deleted:7141f81e-2130-4ea4-bd66-d50c16384aaf for instance a2fe3bb8-40b2-4dea-818a-083e0bc5fb61 on hv-cinder-84614 Jun 30 12:38:26.906521 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [req-4467ee83-08a3-4450-91d8-2c46d3ffa472 req-f60d5b87-6c3b-4b17-843e-f496462b645b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032202 Jun 30 12:38:26.907116 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 289/590] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 30 12:38:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:38:27.791460 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-8a96e9bf-c340-4475-ab40-e26a6785d4b6 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:27.792396 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-8a96e9bf-c340-4475-ab40-e26a6785d4b6 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: a2fe3bb8-40b2-4dea-818a-083e0bc5fb61] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:27.802511 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-8a96e9bf-c340-4475-ab40-e26a6785d4b6 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:27.802928 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-8a96e9bf-c340-4475-ab40-e26a6785d4b6 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:27.803776 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-8a96e9bf-c340-4475-ab40-e26a6785d4b6 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:27.804484 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-8a96e9bf-c340-4475-ab40-e26a6785d4b6 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:27.882227 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-8a96e9bf-c340-4475-ab40-e26a6785d4b6 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:38:27.890000 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-8a96e9bf-c340-4475-ab40-e26a6785d4b6 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61" status: 200 len: 1467 microversion: 2.1 time: 0.105549 Jun 30 12:38:27.890534 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 302/591] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:38:27 2022] GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61 => generated 1467 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:38:28.911856 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-62969283-acbb-468b-8b53-ef8e2f3ce38c tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:28.912556 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-62969283-acbb-468b-8b53-ef8e2f3ce38c tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: a2fe3bb8-40b2-4dea-818a-083e0bc5fb61] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:28.920163 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-62969283-acbb-468b-8b53-ef8e2f3ce38c tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:28.920650 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-62969283-acbb-468b-8b53-ef8e2f3ce38c tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:28.921526 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-62969283-acbb-468b-8b53-ef8e2f3ce38c tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:28.922004 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-62969283-acbb-468b-8b53-ef8e2f3ce38c tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:28.992073 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-62969283-acbb-468b-8b53-ef8e2f3ce38c tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:38:28.999991 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-62969283-acbb-468b-8b53-ef8e2f3ce38c tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61" status: 200 len: 1293 microversion: 2.1 time: 0.094830 Jun 30 12:38:29.000556 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 290/592] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:38:28 2022] GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61 => generated 1293 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:38:30.017164 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-4fd99eb3-0cac-4ff5-9e9d-0880d5873905 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:30.018214 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-4fd99eb3-0cac-4ff5-9e9d-0880d5873905 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: a2fe3bb8-40b2-4dea-818a-083e0bc5fb61] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:30.025069 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-4fd99eb3-0cac-4ff5-9e9d-0880d5873905 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:30.025522 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-4fd99eb3-0cac-4ff5-9e9d-0880d5873905 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:30.026289 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-4fd99eb3-0cac-4ff5-9e9d-0880d5873905 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:30.026723 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-4fd99eb3-0cac-4ff5-9e9d-0880d5873905 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:30.062721 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-4fd99eb3-0cac-4ff5-9e9d-0880d5873905 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:30.063562 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-4fd99eb3-0cac-4ff5-9e9d-0880d5873905 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:30.063941 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.objects.instance [None req-4fd99eb3-0cac-4ff5-9e9d-0880d5873905 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lazy-loading 'fault' on Instance uuid a2fe3bb8-40b2-4dea-818a-083e0bc5fb61 {{(pid=124297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 12:38:30.107997 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-4fd99eb3-0cac-4ff5-9e9d-0880d5873905 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:38:30.115959 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-4fd99eb3-0cac-4ff5-9e9d-0880d5873905 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61" status: 200 len: 1312 microversion: 2.1 time: 0.102785 Jun 30 12:38:30.116530 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 303/593] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:38:30 2022] GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61 => generated 1312 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:38:31.138258 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-233565a5-ee99-42be-9db4-e8229ed23595 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:31.139262 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-233565a5-ee99-42be-9db4-e8229ed23595 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: a2fe3bb8-40b2-4dea-818a-083e0bc5fb61] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:31.150445 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-233565a5-ee99-42be-9db4-e8229ed23595 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:31.151191 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-233565a5-ee99-42be-9db4-e8229ed23595 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:31.152475 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-233565a5-ee99-42be-9db4-e8229ed23595 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:31.153261 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-233565a5-ee99-42be-9db4-e8229ed23595 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:31.169485 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.wsgi [None req-233565a5-ee99-42be-9db4-e8229ed23595 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] HTTP exception thrown: Instance a2fe3bb8-40b2-4dea-818a-083e0bc5fb61 could not be found. Jun 30 12:38:31.171282 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-233565a5-ee99-42be-9db4-e8229ed23595 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Request method failure captured: Jun 30 12:38:31.171282 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: request: GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61 HTTP/1.1 Jun 30 12:38:31.171282 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Accept: application/json Jun 30 12:38:31.171282 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Accept-Encoding: identity Jun 30 12:38:31.171282 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Connection: close Jun 30 12:38:31.171282 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Content-Length: 0 Jun 30 12:38:31.171282 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Content-Type: application/json Jun 30 12:38:31.171282 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Host: 10.222.0.57 Jun 30 12:38:31.171282 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Openstack-System-Scope: None Jun 30 12:38:31.171282 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: User-Agent: python-urllib3/1.26.9 Jun 30 12:38:31.171282 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Auth-Token: gAAAAABivZf_BQGmfS0HOoL_I4T5VOYxBuxZGY2QWD4EHtWbjr8O76qqmYfKKC4FlZ72eOwJFTdgHeD24bmk91RgL5Xpb2Vmu8gdl5stiFwB3gOIKDDDppLMeT3KoEQDYGRtO6bS_AC7MydPE6Kd2zAsainH0ZDMCZDu5MtfqV2V5srDhTVvC8U Jun 30 12:38:31.171282 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Domain-Id: None Jun 30 12:38:31.171282 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Domain-Name: None Jun 30 12:38:31.171282 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Identity-Status: Confirmed Jun 30 12:38:31.171282 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Is-Admin-Project: True Jun 30 12:38:31.171282 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Domain-Id: default Jun 30 12:38:31.171282 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Domain-Name: Default Jun 30 12:38:31.171282 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Id: 663ec7a59bc147299f904d93d119c5e7 Jun 30 12:38:31.171282 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1641653126 Jun 30 12:38:31.171282 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Role: member,reader Jun 30 12:38:31.171282 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Roles: member,reader Jun 30 12:38:31.172577 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/663ec7a59bc147299f904d93d119c5e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/663ec7a59bc147299f904d93d119c5e7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_663ec7a59bc147299f904d93d119c5e7", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/663ec7a59bc147299f904d93d119c5e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 30 12:38:31.172577 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1641653126 Jun 30 12:38:31.172577 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant-Id: 663ec7a59bc147299f904d93d119c5e7 Jun 30 12:38:31.172577 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1641653126 Jun 30 12:38:31.172577 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User: tempest-ServerRescueNegativeTestJSON-1641653126-project Jun 30 12:38:31.172577 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Domain-Id: default Jun 30 12:38:31.172577 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Domain-Name: Default Jun 30 12:38:31.172577 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Id: 26807e5e7aab425eb28e781289794265 Jun 30 12:38:31.172577 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1641653126-project Jun 30 12:38:31.172577 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: method: > Jun 30 12:38:31.172577 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: exception: Instance a2fe3bb8-40b2-4dea-818a-083e0bc5fb61 could not be found. Jun 30 12:38:31.172577 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: action_args: {'id': 'a2fe3bb8-40b2-4dea-818a-083e0bc5fb61'} Jun 30 12:38:31.173392 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 12:38:31.173392 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:38:31.173392 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 12:38:31.173392 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 12:38:31.173392 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 12:38:31.173392 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 12:38:31.173392 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 12:38:31.173392 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 12:38:31.173392 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 12:38:31.173392 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 12:38:31.173392 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2fe3bb8-40b2-4dea-818a-083e0bc5fb61 could not be found. Jun 30 12:38:31.173392 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:38:31.173392 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:38:31.173392 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:38:31.173392 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:38:31.173392 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:38:31.173392 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:38:31.173392 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 12:38:31.173392 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 12:38:31.173392 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 12:38:31.174968 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 12:38:31.174968 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 12:38:31.174968 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 12:38:31.174968 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 12:38:31.174968 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 12:38:31.174968 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 12:38:31.174968 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 12:38:31.174968 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2fe3bb8-40b2-4dea-818a-083e0bc5fb61 could not be found. Jun 30 12:38:31.174968 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:38:31.174968 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:38:31.174968 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:38:31.174968 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:38:31.174968 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:38:31.174968 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:38:31.174968 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 12:38:31.174968 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 12:38:31.174968 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2fe3bb8-40b2-4dea-818a-083e0bc5fb61 could not be found. Jun 30 12:38:31.174968 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:38:31.176252 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-233565a5-ee99-42be-9db4-e8229ed23595 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Returning 404 to user: Instance a2fe3bb8-40b2-4dea-818a-083e0bc5fb61 could not be found. {{(pid=124298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 12:38:31.176252 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-233565a5-ee99-42be-9db4-e8229ed23595 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61" status: 404 len: 111 microversion: 2.1 time: 0.040949 Jun 30 12:38:31.176252 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 291/594] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:38:31 2022] GET /compute/v2.1/servers/a2fe3bb8-40b2-4dea-818a-083e0bc5fb61 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 12:38:31.181547 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-87659441-fa16-4483-a5df-0e4718d403fd tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:31.182042 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-87659441-fa16-4483-a5df-0e4718d403fd tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: 99a31213-cbcb-4b2c-b07f-ab67e78a2096] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:31.189178 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-87659441-fa16-4483-a5df-0e4718d403fd tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:31.189672 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-87659441-fa16-4483-a5df-0e4718d403fd tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:31.190444 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-87659441-fa16-4483-a5df-0e4718d403fd tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:31.190880 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-87659441-fa16-4483-a5df-0e4718d403fd tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:31.216310 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-87659441-fa16-4483-a5df-0e4718d403fd tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: 99a31213-cbcb-4b2c-b07f-ab67e78a2096] Going to try to terminate instance {{(pid=124297) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 12:38:31.299895 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-87659441-fa16-4483-a5df-0e4718d403fd tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "DELETE /compute/v2.1/servers/99a31213-cbcb-4b2c-b07f-ab67e78a2096" status: 204 len: 0 microversion: 2.1 time: 0.121859 Jun 30 12:38:31.300610 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 304/595] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 30 12:38:31 2022] DELETE /compute/v2.1/servers/99a31213-cbcb-4b2c-b07f-ab67e78a2096 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 12:38:31.308948 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-a584a741-3301-480a-984e-11742cd54f18 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:31.309558 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-a584a741-3301-480a-984e-11742cd54f18 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: 99a31213-cbcb-4b2c-b07f-ab67e78a2096] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:31.315865 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-a584a741-3301-480a-984e-11742cd54f18 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:31.316311 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-a584a741-3301-480a-984e-11742cd54f18 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:31.317114 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-a584a741-3301-480a-984e-11742cd54f18 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:31.317550 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-a584a741-3301-480a-984e-11742cd54f18 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:31.461734 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-a584a741-3301-480a-984e-11742cd54f18 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:38:31.469416 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-a584a741-3301-480a-984e-11742cd54f18 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/99a31213-cbcb-4b2c-b07f-ab67e78a2096" status: 200 len: 1522 microversion: 2.1 time: 0.164432 Jun 30 12:38:31.469990 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 292/596] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:38:31 2022] GET /compute/v2.1/servers/99a31213-cbcb-4b2c-b07f-ab67e78a2096 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 12:38:32.491267 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-5cb34d5b-4197-4424-ac16-6b8660cd8c5b tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:32.492170 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-5cb34d5b-4197-4424-ac16-6b8660cd8c5b tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: 99a31213-cbcb-4b2c-b07f-ab67e78a2096] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:32.500584 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-5cb34d5b-4197-4424-ac16-6b8660cd8c5b tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:32.501182 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-5cb34d5b-4197-4424-ac16-6b8660cd8c5b tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:32.502124 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-5cb34d5b-4197-4424-ac16-6b8660cd8c5b tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:32.502646 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-5cb34d5b-4197-4424-ac16-6b8660cd8c5b tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:32.646442 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-5cb34d5b-4197-4424-ac16-6b8660cd8c5b tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:38:32.655864 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-5cb34d5b-4197-4424-ac16-6b8660cd8c5b tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/99a31213-cbcb-4b2c-b07f-ab67e78a2096" status: 200 len: 1522 microversion: 2.1 time: 0.171443 Jun 30 12:38:32.656423 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 305/597] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:38:32 2022] GET /compute/v2.1/servers/99a31213-cbcb-4b2c-b07f-ab67e78a2096 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:38:33.678397 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-37237603-6553-443d-bdd8-b8d3a95e3122 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:33.679444 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-37237603-6553-443d-bdd8-b8d3a95e3122 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: 99a31213-cbcb-4b2c-b07f-ab67e78a2096] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:33.690792 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-37237603-6553-443d-bdd8-b8d3a95e3122 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:33.691237 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-37237603-6553-443d-bdd8-b8d3a95e3122 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:33.692021 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-37237603-6553-443d-bdd8-b8d3a95e3122 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:33.692485 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-37237603-6553-443d-bdd8-b8d3a95e3122 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:33.843681 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-37237603-6553-443d-bdd8-b8d3a95e3122 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:38:33.854665 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-37237603-6553-443d-bdd8-b8d3a95e3122 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/99a31213-cbcb-4b2c-b07f-ab67e78a2096" status: 200 len: 1522 microversion: 2.1 time: 0.183006 Jun 30 12:38:33.855352 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 293/598] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:38:33 2022] GET /compute/v2.1/servers/99a31213-cbcb-4b2c-b07f-ab67e78a2096 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:38:34.878622 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-9d44854d-78c3-498b-9b4f-c0105e116af1 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:34.879686 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-9d44854d-78c3-498b-9b4f-c0105e116af1 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: 99a31213-cbcb-4b2c-b07f-ab67e78a2096] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:34.886702 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-9d44854d-78c3-498b-9b4f-c0105e116af1 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:34.887146 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-9d44854d-78c3-498b-9b4f-c0105e116af1 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:34.887907 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-9d44854d-78c3-498b-9b4f-c0105e116af1 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:34.888335 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-9d44854d-78c3-498b-9b4f-c0105e116af1 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:35.022840 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-9d44854d-78c3-498b-9b4f-c0105e116af1 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:38:35.026409 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG dbcounter [-] [124297] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:35.031170 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-9d44854d-78c3-498b-9b4f-c0105e116af1 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/99a31213-cbcb-4b2c-b07f-ab67e78a2096" status: 200 len: 1522 microversion: 2.1 time: 0.159721 Jun 30 12:38:35.031754 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 306/599] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:38:34 2022] GET /compute/v2.1/servers/99a31213-cbcb-4b2c-b07f-ab67e78a2096 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:38:36.052763 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-e2f2188d-4453-4fe1-91c5-f77ca03a07e7 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:36.053451 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-e2f2188d-4453-4fe1-91c5-f77ca03a07e7 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: 99a31213-cbcb-4b2c-b07f-ab67e78a2096] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:36.062848 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-e2f2188d-4453-4fe1-91c5-f77ca03a07e7 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:36.063441 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-e2f2188d-4453-4fe1-91c5-f77ca03a07e7 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:36.064786 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-e2f2188d-4453-4fe1-91c5-f77ca03a07e7 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:36.065145 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-e2f2188d-4453-4fe1-91c5-f77ca03a07e7 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:36.218180 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-e2f2188d-4453-4fe1-91c5-f77ca03a07e7 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:38:36.226042 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-e2f2188d-4453-4fe1-91c5-f77ca03a07e7 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/99a31213-cbcb-4b2c-b07f-ab67e78a2096" status: 200 len: 1522 microversion: 2.1 time: 0.179664 Jun 30 12:38:36.226667 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 294/600] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:38:36 2022] GET /compute/v2.1/servers/99a31213-cbcb-4b2c-b07f-ab67e78a2096 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:38:37.247428 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-96f5d3c0-94d9-44f6-9b7a-184e2b779d4e tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:37.248122 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-96f5d3c0-94d9-44f6-9b7a-184e2b779d4e tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: 99a31213-cbcb-4b2c-b07f-ab67e78a2096] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:37.259553 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-96f5d3c0-94d9-44f6-9b7a-184e2b779d4e tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:37.260236 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-96f5d3c0-94d9-44f6-9b7a-184e2b779d4e tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:37.261634 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-96f5d3c0-94d9-44f6-9b7a-184e2b779d4e tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:37.262076 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-96f5d3c0-94d9-44f6-9b7a-184e2b779d4e tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:37.297591 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-bd8b6bfd-66e8-4349-aeb8-68936b382c4e tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:37.298132 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-bd8b6bfd-66e8-4349-aeb8-68936b382c4e tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] [instance: 7d480b17-8874-4183-a7ec-3eed3d6bbb1b] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:37.304722 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-bd8b6bfd-66e8-4349-aeb8-68936b382c4e tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:37.305185 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-bd8b6bfd-66e8-4349-aeb8-68936b382c4e tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:37.306074 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-bd8b6bfd-66e8-4349-aeb8-68936b382c4e tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:37.306594 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-bd8b6bfd-66e8-4349-aeb8-68936b382c4e tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:37.391645 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.objects.instance [None req-bd8b6bfd-66e8-4349-aeb8-68936b382c4e tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lazy-loading 'services' on Instance uuid 7d480b17-8874-4183-a7ec-3eed3d6bbb1b {{(pid=124298) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 12:38:37.436957 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-96f5d3c0-94d9-44f6-9b7a-184e2b779d4e tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:38:37.444859 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-96f5d3c0-94d9-44f6-9b7a-184e2b779d4e tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/99a31213-cbcb-4b2c-b07f-ab67e78a2096" status: 200 len: 1522 microversion: 2.1 time: 0.204134 Jun 30 12:38:37.451085 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 307/601] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:38:37 2022] GET /compute/v2.1/servers/99a31213-cbcb-4b2c-b07f-ab67e78a2096 => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:38:37.477897 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-bd8b6bfd-66e8-4349-aeb8-68936b382c4e tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] 10.222.0.57 "DELETE /compute/v2.1/servers/7d480b17-8874-4183-a7ec-3eed3d6bbb1b/os-volume_attachments/59f41819-d944-48da-8aec-c74716987716" status: 202 len: 0 microversion: 2.1 time: 0.181794 Jun 30 12:38:37.478533 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 295/602] 10.222.0.57 () {58 vars in 1415 bytes} [Thu Jun 30 12:38:37 2022] DELETE /compute/v2.1/servers/7d480b17-8874-4183-a7ec-3eed3d6bbb1b/os-volume_attachments/59f41819-d944-48da-8aec-c74716987716 => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 12:38:38.080721 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [req-7cfab213-1b2b-4045-a2f3-2ad2b77219ad req-9ae38f0c-f041-4e16-af88-07948af8bf73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99a31213-cbcb-4b2c-b07f-ab67e78a2096", "name": "network-vif-deleted", "tag": "cedc0eef-3278-4f0e-aa08-b47c9f4b77c6"}]} {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:38:38.089555 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [req-7cfab213-1b2b-4045-a2f3-2ad2b77219ad req-9ae38f0c-f041-4e16-af88-07948af8bf73 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:38.090053 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [req-7cfab213-1b2b-4045-a2f3-2ad2b77219ad req-9ae38f0c-f041-4e16-af88-07948af8bf73 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:38.102081 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.compute.server_external_events [req-7cfab213-1b2b-4045-a2f3-2ad2b77219ad req-9ae38f0c-f041-4e16-af88-07948af8bf73 service nova] Creating event network-vif-deleted:cedc0eef-3278-4f0e-aa08-b47c9f4b77c6 for instance 99a31213-cbcb-4b2c-b07f-ab67e78a2096 on hv-cinder-84614 Jun 30 12:38:38.106955 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [req-7cfab213-1b2b-4045-a2f3-2ad2b77219ad req-9ae38f0c-f041-4e16-af88-07948af8bf73 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.219234 Jun 30 12:38:38.107534 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 308/603] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 30 12:38:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:38:38.464564 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-95bc517b-cc44-4947-bc86-a41702abfa57 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:38.465327 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-95bc517b-cc44-4947-bc86-a41702abfa57 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: 99a31213-cbcb-4b2c-b07f-ab67e78a2096] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:38.471884 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-95bc517b-cc44-4947-bc86-a41702abfa57 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:38.472341 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-95bc517b-cc44-4947-bc86-a41702abfa57 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:38.473276 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-95bc517b-cc44-4947-bc86-a41702abfa57 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:38.473614 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-95bc517b-cc44-4947-bc86-a41702abfa57 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:38.506177 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG dbcounter [-] [124298] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=63,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:38.511282 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-95bc517b-cc44-4947-bc86-a41702abfa57 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:38.511728 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-95bc517b-cc44-4947-bc86-a41702abfa57 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:38.512180 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.objects.instance [None req-95bc517b-cc44-4947-bc86-a41702abfa57 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lazy-loading 'fault' on Instance uuid 99a31213-cbcb-4b2c-b07f-ab67e78a2096 {{(pid=124298) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 12:38:38.564019 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-95bc517b-cc44-4947-bc86-a41702abfa57 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26807e5e7aab425eb28e781289794265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663ec7a59bc147299f904d93d119c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:38:38.577358 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-95bc517b-cc44-4947-bc86-a41702abfa57 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/99a31213-cbcb-4b2c-b07f-ab67e78a2096" status: 200 len: 1312 microversion: 2.1 time: 0.118820 Jun 30 12:38:38.578221 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 296/604] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:38:38 2022] GET /compute/v2.1/servers/99a31213-cbcb-4b2c-b07f-ab67e78a2096 => generated 1312 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:38:38.611892 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-30dc9958-c6d5-4ec8-bf64-782fa0b21e6f tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:38.612617 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-30dc9958-c6d5-4ec8-bf64-782fa0b21e6f tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] [instance: 7d480b17-8874-4183-a7ec-3eed3d6bbb1b] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:38.619613 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-30dc9958-c6d5-4ec8-bf64-782fa0b21e6f tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:38.620058 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-30dc9958-c6d5-4ec8-bf64-782fa0b21e6f tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:38.620887 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-30dc9958-c6d5-4ec8-bf64-782fa0b21e6f tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:38.621302 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-30dc9958-c6d5-4ec8-bf64-782fa0b21e6f tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:38.647522 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-30dc9958-c6d5-4ec8-bf64-782fa0b21e6f tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] [instance: 7d480b17-8874-4183-a7ec-3eed3d6bbb1b] Going to try to terminate instance {{(pid=124297) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 12:38:38.732564 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-30dc9958-c6d5-4ec8-bf64-782fa0b21e6f tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] 10.222.0.57 "DELETE /compute/v2.1/servers/7d480b17-8874-4183-a7ec-3eed3d6bbb1b" status: 204 len: 0 microversion: 2.1 time: 0.125268 Jun 30 12:38:38.733207 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 309/605] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 30 12:38:38 2022] DELETE /compute/v2.1/servers/7d480b17-8874-4183-a7ec-3eed3d6bbb1b => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 12:38:38.741823 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-4fbee365-d3da-4e8c-9826-b770822235fe tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:38.742476 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-4fbee365-d3da-4e8c-9826-b770822235fe tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] [instance: 7d480b17-8874-4183-a7ec-3eed3d6bbb1b] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:38.748889 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-4fbee365-d3da-4e8c-9826-b770822235fe tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:38.749347 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-4fbee365-d3da-4e8c-9826-b770822235fe tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:38.750110 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-4fbee365-d3da-4e8c-9826-b770822235fe tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:38.750544 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-4fbee365-d3da-4e8c-9826-b770822235fe tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:38.769248 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG dbcounter [-] [124298] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:38.902473 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-4fbee365-d3da-4e8c-9826-b770822235fe tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdc0eeb6cd443d78aefefca488d8c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3eabfe3692b44d8ae5f7d137ce1d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:38:38.910999 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-4fbee365-d3da-4e8c-9826-b770822235fe tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] 10.222.0.57 "GET /compute/v2.1/servers/7d480b17-8874-4183-a7ec-3eed3d6bbb1b" status: 200 len: 1513 microversion: 2.1 time: 0.172524 Jun 30 12:38:38.911573 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 297/606] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:38:38 2022] GET /compute/v2.1/servers/7d480b17-8874-4183-a7ec-3eed3d6bbb1b => generated 1513 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:38:39.599210 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-61762bec-65b3-4fe2-a99e-35da25a827c5 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:39.599911 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-61762bec-65b3-4fe2-a99e-35da25a827c5 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] [instance: 99a31213-cbcb-4b2c-b07f-ab67e78a2096] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:39.606774 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-61762bec-65b3-4fe2-a99e-35da25a827c5 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:39.607209 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-61762bec-65b3-4fe2-a99e-35da25a827c5 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:39.607966 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-61762bec-65b3-4fe2-a99e-35da25a827c5 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:39.608403 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-61762bec-65b3-4fe2-a99e-35da25a827c5 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:39.624589 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.wsgi [None req-61762bec-65b3-4fe2-a99e-35da25a827c5 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] HTTP exception thrown: Instance 99a31213-cbcb-4b2c-b07f-ab67e78a2096 could not be found. Jun 30 12:38:39.626269 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-61762bec-65b3-4fe2-a99e-35da25a827c5 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Request method failure captured: Jun 30 12:38:39.626269 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: request: GET /compute/v2.1/servers/99a31213-cbcb-4b2c-b07f-ab67e78a2096 HTTP/1.1 Jun 30 12:38:39.626269 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Accept: application/json Jun 30 12:38:39.626269 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Accept-Encoding: identity Jun 30 12:38:39.626269 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Connection: close Jun 30 12:38:39.626269 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Content-Length: 0 Jun 30 12:38:39.626269 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Content-Type: application/json Jun 30 12:38:39.626269 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Host: 10.222.0.57 Jun 30 12:38:39.626269 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Openstack-System-Scope: None Jun 30 12:38:39.626269 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: User-Agent: python-urllib3/1.26.9 Jun 30 12:38:39.626269 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Auth-Token: gAAAAABivZf_BQGmfS0HOoL_I4T5VOYxBuxZGY2QWD4EHtWbjr8O76qqmYfKKC4FlZ72eOwJFTdgHeD24bmk91RgL5Xpb2Vmu8gdl5stiFwB3gOIKDDDppLMeT3KoEQDYGRtO6bS_AC7MydPE6Kd2zAsainH0ZDMCZDu5MtfqV2V5srDhTVvC8U Jun 30 12:38:39.626269 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Domain-Id: None Jun 30 12:38:39.626269 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Domain-Name: None Jun 30 12:38:39.626269 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Identity-Status: Confirmed Jun 30 12:38:39.626269 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Is-Admin-Project: True Jun 30 12:38:39.626269 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Project-Domain-Id: default Jun 30 12:38:39.626269 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Project-Domain-Name: Default Jun 30 12:38:39.626269 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Project-Id: 663ec7a59bc147299f904d93d119c5e7 Jun 30 12:38:39.626269 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1641653126 Jun 30 12:38:39.626269 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Role: member,reader Jun 30 12:38:39.626269 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Roles: member,reader Jun 30 12:38:39.627826 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/663ec7a59bc147299f904d93d119c5e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/663ec7a59bc147299f904d93d119c5e7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_663ec7a59bc147299f904d93d119c5e7", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/663ec7a59bc147299f904d93d119c5e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 30 12:38:39.627826 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1641653126 Jun 30 12:38:39.627826 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Tenant-Id: 663ec7a59bc147299f904d93d119c5e7 Jun 30 12:38:39.627826 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1641653126 Jun 30 12:38:39.627826 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User: tempest-ServerRescueNegativeTestJSON-1641653126-project Jun 30 12:38:39.627826 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User-Domain-Id: default Jun 30 12:38:39.627826 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User-Domain-Name: Default Jun 30 12:38:39.627826 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User-Id: 26807e5e7aab425eb28e781289794265 Jun 30 12:38:39.627826 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1641653126-project Jun 30 12:38:39.627826 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: method: > Jun 30 12:38:39.627826 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: exception: Instance 99a31213-cbcb-4b2c-b07f-ab67e78a2096 could not be found. Jun 30 12:38:39.627826 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: action_args: {'id': '99a31213-cbcb-4b2c-b07f-ab67e78a2096'} Jun 30 12:38:39.628691 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 12:38:39.628691 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:38:39.628691 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 12:38:39.628691 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 12:38:39.628691 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 12:38:39.628691 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 12:38:39.628691 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 12:38:39.628691 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 12:38:39.628691 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 12:38:39.628691 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 12:38:39.628691 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99a31213-cbcb-4b2c-b07f-ab67e78a2096 could not be found. Jun 30 12:38:39.628691 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:38:39.628691 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:38:39.628691 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:38:39.628691 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:38:39.628691 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:38:39.628691 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:38:39.628691 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 12:38:39.628691 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 12:38:39.628691 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 12:38:39.630371 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 12:38:39.630371 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 12:38:39.630371 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 12:38:39.630371 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 12:38:39.630371 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 12:38:39.630371 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 12:38:39.630371 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 12:38:39.630371 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99a31213-cbcb-4b2c-b07f-ab67e78a2096 could not be found. Jun 30 12:38:39.630371 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:38:39.630371 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:38:39.630371 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:38:39.630371 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:38:39.630371 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:38:39.630371 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:38:39.630371 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 12:38:39.630371 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 12:38:39.630371 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99a31213-cbcb-4b2c-b07f-ab67e78a2096 could not be found. Jun 30 12:38:39.630371 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:38:39.631697 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-61762bec-65b3-4fe2-a99e-35da25a827c5 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] Returning 404 to user: Instance 99a31213-cbcb-4b2c-b07f-ab67e78a2096 could not be found. {{(pid=124297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 12:38:39.631697 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-61762bec-65b3-4fe2-a99e-35da25a827c5 tempest-ServerRescueNegativeTestJSON-1641653126 tempest-ServerRescueNegativeTestJSON-1641653126-project] 10.222.0.57 "GET /compute/v2.1/servers/99a31213-cbcb-4b2c-b07f-ab67e78a2096" status: 404 len: 111 microversion: 2.1 time: 0.035357 Jun 30 12:38:39.631697 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 310/607] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:38:39 2022] GET /compute/v2.1/servers/99a31213-cbcb-4b2c-b07f-ab67e78a2096 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 12:38:39.696269 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-adfaf158-cbac-4a59-bb29-0634378ec719 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:39.696872 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-adfaf158-cbac-4a59-bb29-0634378ec719 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] [instance: 42333613-46ed-4609-bb89-b0e3e7358ea0] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:39.703542 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-adfaf158-cbac-4a59-bb29-0634378ec719 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:39.703989 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-adfaf158-cbac-4a59-bb29-0634378ec719 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:39.704786 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-adfaf158-cbac-4a59-bb29-0634378ec719 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:39.705205 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-adfaf158-cbac-4a59-bb29-0634378ec719 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:39.733306 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-adfaf158-cbac-4a59-bb29-0634378ec719 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] [instance: 42333613-46ed-4609-bb89-b0e3e7358ea0] Going to try to terminate instance {{(pid=124298) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 12:38:39.817395 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-adfaf158-cbac-4a59-bb29-0634378ec719 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] 10.222.0.57 "DELETE /compute/v2.1/servers/42333613-46ed-4609-bb89-b0e3e7358ea0" status: 204 len: 0 microversion: 2.1 time: 0.124688 Jun 30 12:38:39.817963 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 298/608] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 30 12:38:39 2022] DELETE /compute/v2.1/servers/42333613-46ed-4609-bb89-b0e3e7358ea0 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 12:38:39.826286 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-e9dd6d15-b87f-4a20-8b73-c6959052d7a1 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:39.826931 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-e9dd6d15-b87f-4a20-8b73-c6959052d7a1 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] [instance: 42333613-46ed-4609-bb89-b0e3e7358ea0] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:39.833158 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-e9dd6d15-b87f-4a20-8b73-c6959052d7a1 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:39.833674 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-e9dd6d15-b87f-4a20-8b73-c6959052d7a1 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:39.834488 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-e9dd6d15-b87f-4a20-8b73-c6959052d7a1 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:39.834920 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-e9dd6d15-b87f-4a20-8b73-c6959052d7a1 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:39.929212 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-5c86099f-d2e2-4e63-b7ba-a6869899d561 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:39.929906 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-5c86099f-d2e2-4e63-b7ba-a6869899d561 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] [instance: 7d480b17-8874-4183-a7ec-3eed3d6bbb1b] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:39.936458 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-5c86099f-d2e2-4e63-b7ba-a6869899d561 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:39.937013 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-5c86099f-d2e2-4e63-b7ba-a6869899d561 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:39.937994 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-5c86099f-d2e2-4e63-b7ba-a6869899d561 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:39.938462 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-5c86099f-d2e2-4e63-b7ba-a6869899d561 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:40.112547 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-e9dd6d15-b87f-4a20-8b73-c6959052d7a1 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72419918d6c34080b6a4a4c73b2c06b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b272349089480984fd1c5eabe6dce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:38:40.121223 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-e9dd6d15-b87f-4a20-8b73-c6959052d7a1 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] 10.222.0.57 "GET /compute/v2.1/servers/42333613-46ed-4609-bb89-b0e3e7358ea0" status: 200 len: 1577 microversion: 2.1 time: 0.298732 Jun 30 12:38:40.121800 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 311/609] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:38:39 2022] GET /compute/v2.1/servers/42333613-46ed-4609-bb89-b0e3e7358ea0 => generated 1577 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:38:40.198297 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-5c86099f-d2e2-4e63-b7ba-a6869899d561 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdc0eeb6cd443d78aefefca488d8c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3eabfe3692b44d8ae5f7d137ce1d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:38:40.206283 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-5c86099f-d2e2-4e63-b7ba-a6869899d561 tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] 10.222.0.57 "GET /compute/v2.1/servers/7d480b17-8874-4183-a7ec-3eed3d6bbb1b" status: 200 len: 1513 microversion: 2.1 time: 0.281777 Jun 30 12:38:40.206861 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 299/610] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:38:39 2022] GET /compute/v2.1/servers/7d480b17-8874-4183-a7ec-3eed3d6bbb1b => generated 1513 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:38:41.139274 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-13a7b934-1cbf-49c1-a0d9-04a4679dae04 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:41.139832 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-13a7b934-1cbf-49c1-a0d9-04a4679dae04 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] [instance: 42333613-46ed-4609-bb89-b0e3e7358ea0] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:41.146868 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-13a7b934-1cbf-49c1-a0d9-04a4679dae04 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:41.147322 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-13a7b934-1cbf-49c1-a0d9-04a4679dae04 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:41.148059 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-13a7b934-1cbf-49c1-a0d9-04a4679dae04 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:41.148485 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-13a7b934-1cbf-49c1-a0d9-04a4679dae04 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:41.224148 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-347874d9-13a9-4bec-813f-96463f8a99de tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:41.224804 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-347874d9-13a9-4bec-813f-96463f8a99de tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] [instance: 7d480b17-8874-4183-a7ec-3eed3d6bbb1b] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:41.231463 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-347874d9-13a9-4bec-813f-96463f8a99de tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:41.231904 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-347874d9-13a9-4bec-813f-96463f8a99de tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:41.232659 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-347874d9-13a9-4bec-813f-96463f8a99de tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:41.233134 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-347874d9-13a9-4bec-813f-96463f8a99de tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:41.368185 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-13a7b934-1cbf-49c1-a0d9-04a4679dae04 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72419918d6c34080b6a4a4c73b2c06b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b272349089480984fd1c5eabe6dce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:38:41.376270 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-13a7b934-1cbf-49c1-a0d9-04a4679dae04 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] 10.222.0.57 "GET /compute/v2.1/servers/42333613-46ed-4609-bb89-b0e3e7358ea0" status: 200 len: 1577 microversion: 2.1 time: 0.241080 Jun 30 12:38:41.376975 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 312/611] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:38:41 2022] GET /compute/v2.1/servers/42333613-46ed-4609-bb89-b0e3e7358ea0 => generated 1577 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:38:41.478274 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-347874d9-13a9-4bec-813f-96463f8a99de tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdc0eeb6cd443d78aefefca488d8c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3eabfe3692b44d8ae5f7d137ce1d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:38:41.486119 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-347874d9-13a9-4bec-813f-96463f8a99de tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] 10.222.0.57 "GET /compute/v2.1/servers/7d480b17-8874-4183-a7ec-3eed3d6bbb1b" status: 200 len: 1513 microversion: 2.1 time: 0.266426 Jun 30 12:38:41.486697 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 300/612] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:38:41 2022] GET /compute/v2.1/servers/7d480b17-8874-4183-a7ec-3eed3d6bbb1b => generated 1513 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:38:42.395273 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-9c9c31e0-59dc-4c07-9fd6-06c3486c0461 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:42.395866 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-9c9c31e0-59dc-4c07-9fd6-06c3486c0461 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] [instance: 42333613-46ed-4609-bb89-b0e3e7358ea0] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:42.398348 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG dbcounter [-] [124297] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=3 {{(pid=124297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:42.404035 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-9c9c31e0-59dc-4c07-9fd6-06c3486c0461 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:42.404478 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-9c9c31e0-59dc-4c07-9fd6-06c3486c0461 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:42.405269 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-9c9c31e0-59dc-4c07-9fd6-06c3486c0461 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:42.405693 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-9c9c31e0-59dc-4c07-9fd6-06c3486c0461 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:42.511758 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-e6762a8d-8a48-48d4-b107-58f9b230dabb tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:42.513145 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-e6762a8d-8a48-48d4-b107-58f9b230dabb tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] [instance: 7d480b17-8874-4183-a7ec-3eed3d6bbb1b] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:42.520685 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-e6762a8d-8a48-48d4-b107-58f9b230dabb tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:42.521524 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-e6762a8d-8a48-48d4-b107-58f9b230dabb tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:42.522535 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-e6762a8d-8a48-48d4-b107-58f9b230dabb tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:42.523195 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-e6762a8d-8a48-48d4-b107-58f9b230dabb tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:42.804308 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-9c9c31e0-59dc-4c07-9fd6-06c3486c0461 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72419918d6c34080b6a4a4c73b2c06b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b272349089480984fd1c5eabe6dce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:38:42.814792 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-9c9c31e0-59dc-4c07-9fd6-06c3486c0461 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] 10.222.0.57 "GET /compute/v2.1/servers/42333613-46ed-4609-bb89-b0e3e7358ea0" status: 200 len: 1577 microversion: 2.1 time: 0.423772 Jun 30 12:38:42.818435 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 313/613] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:38:42 2022] GET /compute/v2.1/servers/42333613-46ed-4609-bb89-b0e3e7358ea0 => generated 1577 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:38:42.853889 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-e6762a8d-8a48-48d4-b107-58f9b230dabb tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdc0eeb6cd443d78aefefca488d8c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3eabfe3692b44d8ae5f7d137ce1d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:38:42.862444 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-e6762a8d-8a48-48d4-b107-58f9b230dabb tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] 10.222.0.57 "GET /compute/v2.1/servers/7d480b17-8874-4183-a7ec-3eed3d6bbb1b" status: 200 len: 1513 microversion: 2.1 time: 0.357402 Jun 30 12:38:42.863277 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 301/614] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:38:42 2022] GET /compute/v2.1/servers/7d480b17-8874-4183-a7ec-3eed3d6bbb1b => generated 1513 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:38:42.940615 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [req-af46285f-f155-4130-8c2b-23b0267d9a2a req-72ab52f6-9dfa-4273-8f8f-f298a81ce198 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d480b17-8874-4183-a7ec-3eed3d6bbb1b", "name": "network-vif-deleted", "tag": "2d091604-c7cf-4cf1-a44d-5310eae90174"}]} {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:38:42.949889 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [req-af46285f-f155-4130-8c2b-23b0267d9a2a req-72ab52f6-9dfa-4273-8f8f-f298a81ce198 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:42.950595 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [req-af46285f-f155-4130-8c2b-23b0267d9a2a req-72ab52f6-9dfa-4273-8f8f-f298a81ce198 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:42.962838 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.compute.server_external_events [req-af46285f-f155-4130-8c2b-23b0267d9a2a req-72ab52f6-9dfa-4273-8f8f-f298a81ce198 service nova] Creating event network-vif-deleted:2d091604-c7cf-4cf1-a44d-5310eae90174 for instance 7d480b17-8874-4183-a7ec-3eed3d6bbb1b on hv-cinder-84614 Jun 30 12:38:42.968046 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [req-af46285f-f155-4130-8c2b-23b0267d9a2a req-72ab52f6-9dfa-4273-8f8f-f298a81ce198 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032910 Jun 30 12:38:42.968621 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 314/615] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 30 12:38:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:38:43.443606 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [req-78cace3c-3769-4233-960c-c445d6764809 req-a58e7c9f-ffc5-4458-9a7b-38aca205771a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42333613-46ed-4609-bb89-b0e3e7358ea0", "name": "network-vif-deleted", "tag": "666490d7-bc72-4807-aafd-f8b8f454ed23"}]} {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:38:43.469379 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [req-78cace3c-3769-4233-960c-c445d6764809 req-a58e7c9f-ffc5-4458-9a7b-38aca205771a service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:43.470065 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [req-78cace3c-3769-4233-960c-c445d6764809 req-a58e7c9f-ffc5-4458-9a7b-38aca205771a service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:43.484086 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.compute.server_external_events [req-78cace3c-3769-4233-960c-c445d6764809 req-a58e7c9f-ffc5-4458-9a7b-38aca205771a service nova] Creating event network-vif-deleted:666490d7-bc72-4807-aafd-f8b8f454ed23 for instance 42333613-46ed-4609-bb89-b0e3e7358ea0 on hv-cinder-84614 Jun 30 12:38:43.490079 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [req-78cace3c-3769-4233-960c-c445d6764809 req-a58e7c9f-ffc5-4458-9a7b-38aca205771a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120028 Jun 30 12:38:43.490745 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 302/616] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 30 12:38:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:38:43.846724 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-f0df74be-90d4-4721-99e8-1241e745f78d tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:43.848402 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-f0df74be-90d4-4721-99e8-1241e745f78d tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] [instance: 42333613-46ed-4609-bb89-b0e3e7358ea0] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:43.872271 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-f0df74be-90d4-4721-99e8-1241e745f78d tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:43.876309 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-f0df74be-90d4-4721-99e8-1241e745f78d tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:43.879001 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-f0df74be-90d4-4721-99e8-1241e745f78d tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:43.879730 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-f0df74be-90d4-4721-99e8-1241e745f78d tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:43.890990 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-c5190ec0-594d-46be-9fae-45bad14d2f9c tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:43.891703 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-c5190ec0-594d-46be-9fae-45bad14d2f9c tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] [instance: 7d480b17-8874-4183-a7ec-3eed3d6bbb1b] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:43.899531 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-c5190ec0-594d-46be-9fae-45bad14d2f9c tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:43.899980 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-c5190ec0-594d-46be-9fae-45bad14d2f9c tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:43.900790 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-c5190ec0-594d-46be-9fae-45bad14d2f9c tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:43.901229 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-c5190ec0-594d-46be-9fae-45bad14d2f9c tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:43.917926 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.wsgi [None req-c5190ec0-594d-46be-9fae-45bad14d2f9c tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] HTTP exception thrown: Instance 7d480b17-8874-4183-a7ec-3eed3d6bbb1b could not be found. Jun 30 12:38:43.919938 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-c5190ec0-594d-46be-9fae-45bad14d2f9c tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Request method failure captured: Jun 30 12:38:43.919938 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: request: GET /compute/v2.1/servers/7d480b17-8874-4183-a7ec-3eed3d6bbb1b HTTP/1.1 Jun 30 12:38:43.919938 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Accept: application/json Jun 30 12:38:43.919938 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Accept-Encoding: identity Jun 30 12:38:43.919938 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Connection: close Jun 30 12:38:43.919938 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Content-Length: 0 Jun 30 12:38:43.919938 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Content-Type: application/json Jun 30 12:38:43.919938 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Host: 10.222.0.57 Jun 30 12:38:43.919938 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Openstack-System-Scope: None Jun 30 12:38:43.919938 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: User-Agent: python-urllib3/1.26.9 Jun 30 12:38:43.919938 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Auth-Token: gAAAAABivZjWjLASIkgEAJVFiE1fOQTNLbsj7988LOtStRRtLtUsDo-YsdIJQkOq4GkobxKS7GtZElIil-0_YOs5BM2ZaXISf6ZrMcRGvYPCCRLWN0v9kEkCT6WQuciWD9eTTJg_u-mm-Cn9odatXePB6wJfaF2pAR1_cW2tOieOxWoCsTKWgiM Jun 30 12:38:43.919938 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Domain-Id: None Jun 30 12:38:43.919938 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Domain-Name: None Jun 30 12:38:43.919938 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Identity-Status: Confirmed Jun 30 12:38:43.919938 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Is-Admin-Project: True Jun 30 12:38:43.919938 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Domain-Id: default Jun 30 12:38:43.919938 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Domain-Name: Default Jun 30 12:38:43.919938 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Id: e3eabfe3692b44d8ae5f7d137ce1d157 Jun 30 12:38:43.919938 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Name: tempest-VolumesSnapshotTestJSON-294987499 Jun 30 12:38:43.919938 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Role: member,reader Jun 30 12:38:43.919938 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Roles: member,reader Jun 30 12:38:43.921466 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/e3eabfe3692b44d8ae5f7d137ce1d157"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e3eabfe3692b44d8ae5f7d137ce1d157"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_e3eabfe3692b44d8ae5f7d137ce1d157", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e3eabfe3692b44d8ae5f7d137ce1d157"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 30 12:38:43.921466 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant: tempest-VolumesSnapshotTestJSON-294987499 Jun 30 12:38:43.921466 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant-Id: e3eabfe3692b44d8ae5f7d137ce1d157 Jun 30 12:38:43.921466 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-294987499 Jun 30 12:38:43.921466 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User: tempest-VolumesSnapshotTestJSON-294987499-project Jun 30 12:38:43.921466 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Domain-Id: default Jun 30 12:38:43.921466 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Domain-Name: Default Jun 30 12:38:43.921466 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Id: 4bdc0eeb6cd443d78aefefca488d8c5d Jun 30 12:38:43.921466 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Name: tempest-VolumesSnapshotTestJSON-294987499-project Jun 30 12:38:43.921466 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: method: > Jun 30 12:38:43.921466 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: exception: Instance 7d480b17-8874-4183-a7ec-3eed3d6bbb1b could not be found. Jun 30 12:38:43.921466 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: action_args: {'id': '7d480b17-8874-4183-a7ec-3eed3d6bbb1b'} Jun 30 12:38:43.922205 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 12:38:43.922205 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:38:43.922205 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 12:38:43.922205 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 12:38:43.922205 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 12:38:43.922205 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 12:38:43.922205 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 12:38:43.922205 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 12:38:43.922205 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 12:38:43.922205 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 12:38:43.922205 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d480b17-8874-4183-a7ec-3eed3d6bbb1b could not be found. Jun 30 12:38:43.922205 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:38:43.922205 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:38:43.922205 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:38:43.922205 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:38:43.922205 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:38:43.922205 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:38:43.922205 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 12:38:43.922205 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 12:38:43.922205 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 12:38:43.923407 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 12:38:43.923407 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 12:38:43.923407 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 12:38:43.923407 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 12:38:43.923407 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 12:38:43.923407 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 12:38:43.923407 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 12:38:43.923407 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d480b17-8874-4183-a7ec-3eed3d6bbb1b could not be found. Jun 30 12:38:43.923407 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:38:43.923407 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:38:43.923407 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:38:43.923407 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:38:43.923407 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:38:43.923407 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:38:43.923407 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 12:38:43.923407 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 12:38:43.923407 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d480b17-8874-4183-a7ec-3eed3d6bbb1b could not be found. Jun 30 12:38:43.923407 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:38:43.926446 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-c5190ec0-594d-46be-9fae-45bad14d2f9c tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] Returning 404 to user: Instance 7d480b17-8874-4183-a7ec-3eed3d6bbb1b could not be found. {{(pid=124298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 12:38:43.927498 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-f0df74be-90d4-4721-99e8-1241e745f78d tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:43.928082 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-c5190ec0-594d-46be-9fae-45bad14d2f9c tempest-VolumesSnapshotTestJSON-294987499 tempest-VolumesSnapshotTestJSON-294987499-project] 10.222.0.57 "GET /compute/v2.1/servers/7d480b17-8874-4183-a7ec-3eed3d6bbb1b" status: 404 len: 111 microversion: 2.1 time: 0.048170 Jun 30 12:38:43.928304 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-f0df74be-90d4-4721-99e8-1241e745f78d tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:43.928848 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 303/617] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:38:43 2022] GET /compute/v2.1/servers/7d480b17-8874-4183-a7ec-3eed3d6bbb1b => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 12:38:43.936289 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.objects.instance [None req-f0df74be-90d4-4721-99e8-1241e745f78d tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lazy-loading 'fault' on Instance uuid 42333613-46ed-4609-bb89-b0e3e7358ea0 {{(pid=124297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 12:38:43.978981 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-f0df74be-90d4-4721-99e8-1241e745f78d tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72419918d6c34080b6a4a4c73b2c06b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b272349089480984fd1c5eabe6dce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:38:43.992424 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-f0df74be-90d4-4721-99e8-1241e745f78d tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] 10.222.0.57 "GET /compute/v2.1/servers/42333613-46ed-4609-bb89-b0e3e7358ea0" status: 200 len: 1231 microversion: 2.1 time: 0.160511 Jun 30 12:38:43.994001 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 315/618] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:38:43 2022] GET /compute/v2.1/servers/42333613-46ed-4609-bb89-b0e3e7358ea0 => generated 1231 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:38:45.010034 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-72876b1c-e96b-45ea-b520-be6eeb23e83c tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:45.010639 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-72876b1c-e96b-45ea-b520-be6eeb23e83c tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] [instance: 42333613-46ed-4609-bb89-b0e3e7358ea0] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:45.017386 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-72876b1c-e96b-45ea-b520-be6eeb23e83c tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:45.017828 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-72876b1c-e96b-45ea-b520-be6eeb23e83c tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:45.018595 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-72876b1c-e96b-45ea-b520-be6eeb23e83c tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:45.019019 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-72876b1c-e96b-45ea-b520-be6eeb23e83c tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:45.033201 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.wsgi [None req-72876b1c-e96b-45ea-b520-be6eeb23e83c tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] HTTP exception thrown: Instance 42333613-46ed-4609-bb89-b0e3e7358ea0 could not be found. Jun 30 12:38:45.035661 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-72876b1c-e96b-45ea-b520-be6eeb23e83c tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Request method failure captured: Jun 30 12:38:45.035661 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: request: GET /compute/v2.1/servers/42333613-46ed-4609-bb89-b0e3e7358ea0 HTTP/1.1 Jun 30 12:38:45.035661 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Accept: application/json Jun 30 12:38:45.035661 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Accept-Encoding: identity Jun 30 12:38:45.035661 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Connection: close Jun 30 12:38:45.035661 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Content-Length: 0 Jun 30 12:38:45.035661 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Content-Type: application/json Jun 30 12:38:45.035661 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Host: 10.222.0.57 Jun 30 12:38:45.035661 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Openstack-System-Scope: None Jun 30 12:38:45.035661 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: User-Agent: python-urllib3/1.26.9 Jun 30 12:38:45.035661 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Auth-Token: gAAAAABivZiCPNUV0kunj7abCRZKBEOSX_NBKR-P_YuEbI2MRrkPEtzdN_qWTKp6tAKx_HozBYA0Xvwhe_1LWzjKJlMRQsu9d7JGjn7xjw4fusXzSn0Ke-uIFi50icRYKg0NADR2TlaDwux5dqquUKh8n6yPiLjd2ZYPAhLeyVPik5UqOdEN7J4 Jun 30 12:38:45.035661 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Domain-Id: None Jun 30 12:38:45.035661 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Domain-Name: None Jun 30 12:38:45.035661 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Identity-Status: Confirmed Jun 30 12:38:45.035661 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Is-Admin-Project: True Jun 30 12:38:45.035661 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Domain-Id: default Jun 30 12:38:45.035661 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Domain-Name: Default Jun 30 12:38:45.035661 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Id: c7b272349089480984fd1c5eabe6dce9 Jun 30 12:38:45.035661 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Name: tempest-TestVolumeBootPattern-344479508 Jun 30 12:38:45.035661 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Role: member,reader Jun 30 12:38:45.035661 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Roles: member,reader Jun 30 12:38:45.037042 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c7b272349089480984fd1c5eabe6dce9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c7b272349089480984fd1c5eabe6dce9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c7b272349089480984fd1c5eabe6dce9", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c7b272349089480984fd1c5eabe6dce9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 30 12:38:45.037042 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant: tempest-TestVolumeBootPattern-344479508 Jun 30 12:38:45.037042 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant-Id: c7b272349089480984fd1c5eabe6dce9 Jun 30 12:38:45.037042 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant-Name: tempest-TestVolumeBootPattern-344479508 Jun 30 12:38:45.037042 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User: tempest-TestVolumeBootPattern-344479508-project Jun 30 12:38:45.037042 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Domain-Id: default Jun 30 12:38:45.037042 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Domain-Name: Default Jun 30 12:38:45.037042 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Id: 72419918d6c34080b6a4a4c73b2c06b2 Jun 30 12:38:45.037042 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Name: tempest-TestVolumeBootPattern-344479508-project Jun 30 12:38:45.037042 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: method: > Jun 30 12:38:45.037042 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: exception: Instance 42333613-46ed-4609-bb89-b0e3e7358ea0 could not be found. Jun 30 12:38:45.037042 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: action_args: {'id': '42333613-46ed-4609-bb89-b0e3e7358ea0'} Jun 30 12:38:45.037800 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 12:38:45.037800 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:38:45.037800 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 12:38:45.037800 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 12:38:45.037800 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 12:38:45.037800 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 12:38:45.037800 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 12:38:45.037800 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 12:38:45.037800 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 12:38:45.037800 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 12:38:45.037800 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42333613-46ed-4609-bb89-b0e3e7358ea0 could not be found. Jun 30 12:38:45.037800 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:38:45.037800 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:38:45.037800 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:38:45.037800 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:38:45.037800 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:38:45.037800 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:38:45.037800 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 12:38:45.037800 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 12:38:45.037800 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 12:38:45.038967 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 12:38:45.038967 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 12:38:45.038967 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 12:38:45.038967 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 12:38:45.038967 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 12:38:45.038967 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 12:38:45.038967 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 12:38:45.038967 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42333613-46ed-4609-bb89-b0e3e7358ea0 could not be found. Jun 30 12:38:45.038967 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:38:45.038967 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:38:45.038967 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:38:45.038967 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:38:45.038967 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:38:45.038967 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:38:45.038967 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 12:38:45.038967 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 12:38:45.038967 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42333613-46ed-4609-bb89-b0e3e7358ea0 could not be found. Jun 30 12:38:45.038967 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:38:45.040077 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-72876b1c-e96b-45ea-b520-be6eeb23e83c tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Returning 404 to user: Instance 42333613-46ed-4609-bb89-b0e3e7358ea0 could not be found. {{(pid=124298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 12:38:45.040077 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-72876b1c-e96b-45ea-b520-be6eeb23e83c tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] 10.222.0.57 "GET /compute/v2.1/servers/42333613-46ed-4609-bb89-b0e3e7358ea0" status: 404 len: 111 microversion: 2.1 time: 0.030797 Jun 30 12:38:45.040077 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 304/619] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:38:45 2022] GET /compute/v2.1/servers/42333613-46ed-4609-bb89-b0e3e7358ea0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 12:38:45.140097 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-3992c6b9-cc47-4976-ba97-36788a373214 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-391739200", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1101131035", "security_groups": [{"name": "tempest-secgroup-smoke-489166712"}], "block_device_mapping_v2": [{"uuid": "43428fcb-2ce3-4240-8672-514b1a597cab", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "060511a0-e46f-4c0e-a70d-d0864d8ba380"}]}} {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:38:45.256400 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.network.neutron [None req-3992c6b9-cc47-4976-ba97-36788a373214 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] validate_networks() for [('060511a0-e46f-4c0e-a70d-d0864d8ba380', None, None, None, None, None)] {{(pid=124297) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 12:38:45.780313 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.virt.hardware [None req-3992c6b9-cc47-4976-ba97-36788a373214 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Flavor limits 0:0:0 {{(pid=124297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 12:38:45.780830 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.virt.hardware [None req-3992c6b9-cc47-4976-ba97-36788a373214 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Image limits 0:0:0 {{(pid=124297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 12:38:45.781373 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.virt.hardware [None req-3992c6b9-cc47-4976-ba97-36788a373214 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Flavor pref 0:0:0 {{(pid=124297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 12:38:45.781868 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.virt.hardware [None req-3992c6b9-cc47-4976-ba97-36788a373214 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Image pref 0:0:0 {{(pid=124297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 12:38:45.782335 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.virt.hardware [None req-3992c6b9-cc47-4976-ba97-36788a373214 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 12:38:45.798269 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-3992c6b9-cc47-4976-ba97-36788a373214 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:45.798873 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-3992c6b9-cc47-4976-ba97-36788a373214 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:45.799896 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-3992c6b9-cc47-4976-ba97-36788a373214 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:45.800387 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-3992c6b9-cc47-4976-ba97-36788a373214 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:45.818620 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.quota [None req-3992c6b9-cc47-4976-ba97-36788a373214 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Getting quotas for project c7b272349089480984fd1c5eabe6dce9. Resources: {'cores', 'ram', 'instances'} {{(pid=124297) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 12:38:45.822902 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.quota [None req-3992c6b9-cc47-4976-ba97-36788a373214 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Getting quotas for user 72419918d6c34080b6a4a4c73b2c06b2 and project c7b272349089480984fd1c5eabe6dce9. Resources: {'cores', 'ram', 'instances'} {{(pid=124297) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 12:38:45.888992 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-3992c6b9-cc47-4976-ba97-36788a373214 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Going to run 1 instances... {{(pid=124297) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 12:38:45.891331 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-3992c6b9-cc47-4976-ba97-36788a373214 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] [instance: ad5ae807-1a12-48f7-b582-d2ffe80d6cb1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='43428fcb-2ce3-4240-8672-514b1a597cab',volume_size=None,volume_type=None)] {{(pid=124297) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 12:38:46.042154 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-3992c6b9-cc47-4976-ba97-36788a373214 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.905901 Jun 30 12:38:46.042780 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 316/620] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 30 12:38:45 2022] POST /compute/v2.1/servers => generated 405 bytes in 907 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 12:38:46.053588 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-888d2660-69ce-4913-b928-7efeae88d400 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:46.054505 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-888d2660-69ce-4913-b928-7efeae88d400 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] [instance: ad5ae807-1a12-48f7-b582-d2ffe80d6cb1] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:46.130193 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-888d2660-69ce-4913-b928-7efeae88d400 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72419918d6c34080b6a4a4c73b2c06b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b272349089480984fd1c5eabe6dce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:38:46.137248 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-888d2660-69ce-4913-b928-7efeae88d400 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] 10.222.0.57 "GET /compute/v2.1/servers/ad5ae807-1a12-48f7-b582-d2ffe80d6cb1" status: 200 len: 1094 microversion: 2.1 time: 0.088158 Jun 30 12:38:46.138335 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 305/621] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:38:46 2022] GET /compute/v2.1/servers/ad5ae807-1a12-48f7-b582-d2ffe80d6cb1 => generated 1094 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:38:46.564548 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-1ec9c0ac-3150-4bee-b271-d84a2ae40ec1 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:38:46.565182 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-1ec9c0ac-3150-4bee-b271-d84a2ae40ec1 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] [instance: 17ef4273-4c60-498a-9061-2c4fbedbafdb] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:46.572095 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-1ec9c0ac-3150-4bee-b271-d84a2ae40ec1 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:46.572780 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-1ec9c0ac-3150-4bee-b271-d84a2ae40ec1 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:46.573745 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-1ec9c0ac-3150-4bee-b271-d84a2ae40ec1 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:46.574333 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-1ec9c0ac-3150-4bee-b271-d84a2ae40ec1 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:46.598360 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.objects.instance [None req-1ec9c0ac-3150-4bee-b271-d84a2ae40ec1 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lazy-loading 'flavor' on Instance uuid 17ef4273-4c60-498a-9061-2c4fbedbafdb {{(pid=124297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 12:38:46.688917 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-1ec9c0ac-3150-4bee-b271-d84a2ae40ec1 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] 10.222.0.57 "POST /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb/action" status: 202 len: 0 microversion: 2.1 time: 0.128332 Jun 30 12:38:46.690011 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 317/622] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Jun 30 12:38:46 2022] POST /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 12:38:46.699704 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-63bb81bf-ca93-4868-aeb5-99b487382b8d tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:46.700670 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-63bb81bf-ca93-4868-aeb5-99b487382b8d tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] [instance: 17ef4273-4c60-498a-9061-2c4fbedbafdb] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:46.709182 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-63bb81bf-ca93-4868-aeb5-99b487382b8d tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:46.709896 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-63bb81bf-ca93-4868-aeb5-99b487382b8d tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:46.710892 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-63bb81bf-ca93-4868-aeb5-99b487382b8d tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:46.711427 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-63bb81bf-ca93-4868-aeb5-99b487382b8d tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:46.942163 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-63bb81bf-ca93-4868-aeb5-99b487382b8d tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81aa9d47cd1470abef31a27839eaf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8abe616c14a4920b1cbc45733fa5771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:38:46.952159 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-63bb81bf-ca93-4868-aeb5-99b487382b8d tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] 10.222.0.57 "GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb" status: 200 len: 1569 microversion: 2.1 time: 0.256201 Jun 30 12:38:46.954923 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 306/623] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:38:46 2022] GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb => generated 1569 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:38:47.162186 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-d4810d98-84fa-4641-9193-004808ef87ba tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:47.163265 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-d4810d98-84fa-4641-9193-004808ef87ba tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] [instance: ad5ae807-1a12-48f7-b582-d2ffe80d6cb1] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:47.173674 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-d4810d98-84fa-4641-9193-004808ef87ba tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:47.180206 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-d4810d98-84fa-4641-9193-004808ef87ba tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:47.181143 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-d4810d98-84fa-4641-9193-004808ef87ba tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:47.181653 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-d4810d98-84fa-4641-9193-004808ef87ba tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:47.290899 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-d4810d98-84fa-4641-9193-004808ef87ba tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72419918d6c34080b6a4a4c73b2c06b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b272349089480984fd1c5eabe6dce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:38:47.299154 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-d4810d98-84fa-4641-9193-004808ef87ba tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] 10.222.0.57 "GET /compute/v2.1/servers/ad5ae807-1a12-48f7-b582-d2ffe80d6cb1" status: 200 len: 1144 microversion: 2.1 time: 0.147535 Jun 30 12:38:47.299687 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 318/624] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:38:47 2022] GET /compute/v2.1/servers/ad5ae807-1a12-48f7-b582-d2ffe80d6cb1 => generated 1144 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:38:47.974340 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-df3339ff-a7b6-43d9-8aa9-b4073a3d249d tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:47.975729 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-df3339ff-a7b6-43d9-8aa9-b4073a3d249d tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] [instance: 17ef4273-4c60-498a-9061-2c4fbedbafdb] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:47.984134 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-df3339ff-a7b6-43d9-8aa9-b4073a3d249d tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:47.984896 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-df3339ff-a7b6-43d9-8aa9-b4073a3d249d tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:47.985946 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-df3339ff-a7b6-43d9-8aa9-b4073a3d249d tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:47.986478 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-df3339ff-a7b6-43d9-8aa9-b4073a3d249d tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:48.216918 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-df3339ff-a7b6-43d9-8aa9-b4073a3d249d tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81aa9d47cd1470abef31a27839eaf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8abe616c14a4920b1cbc45733fa5771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:38:48.228655 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-df3339ff-a7b6-43d9-8aa9-b4073a3d249d tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] 10.222.0.57 "GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb" status: 200 len: 1569 microversion: 2.1 time: 0.261971 Jun 30 12:38:48.229985 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 307/625] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:38:47 2022] GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb => generated 1569 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:38:48.319260 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-5c6c225d-8722-4dda-ab82-6c4f6e65e853 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:48.319985 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-5c6c225d-8722-4dda-ab82-6c4f6e65e853 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] [instance: ad5ae807-1a12-48f7-b582-d2ffe80d6cb1] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:48.328129 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-5c6c225d-8722-4dda-ab82-6c4f6e65e853 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:48.328665 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-5c6c225d-8722-4dda-ab82-6c4f6e65e853 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:48.329542 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-5c6c225d-8722-4dda-ab82-6c4f6e65e853 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:48.330037 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-5c6c225d-8722-4dda-ab82-6c4f6e65e853 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:48.438517 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-5c6c225d-8722-4dda-ab82-6c4f6e65e853 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72419918d6c34080b6a4a4c73b2c06b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b272349089480984fd1c5eabe6dce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:38:48.446625 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-5c6c225d-8722-4dda-ab82-6c4f6e65e853 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] 10.222.0.57 "GET /compute/v2.1/servers/ad5ae807-1a12-48f7-b582-d2ffe80d6cb1" status: 200 len: 1144 microversion: 2.1 time: 0.134739 Jun 30 12:38:48.447423 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 319/626] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:38:48 2022] GET /compute/v2.1/servers/ad5ae807-1a12-48f7-b582-d2ffe80d6cb1 => generated 1144 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:38:49.248894 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-801ad18e-ca4a-4dc5-a977-fae8883a3045 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:49.250143 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-801ad18e-ca4a-4dc5-a977-fae8883a3045 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] [instance: 17ef4273-4c60-498a-9061-2c4fbedbafdb] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:49.266862 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-801ad18e-ca4a-4dc5-a977-fae8883a3045 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:49.267417 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-801ad18e-ca4a-4dc5-a977-fae8883a3045 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:49.268291 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-801ad18e-ca4a-4dc5-a977-fae8883a3045 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:49.268753 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-801ad18e-ca4a-4dc5-a977-fae8883a3045 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:49.465134 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-be85f73d-6660-4cb4-9fa7-5b390b5e5588 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:49.465752 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-be85f73d-6660-4cb4-9fa7-5b390b5e5588 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] [instance: ad5ae807-1a12-48f7-b582-d2ffe80d6cb1] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:49.475067 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-be85f73d-6660-4cb4-9fa7-5b390b5e5588 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:49.475973 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-be85f73d-6660-4cb4-9fa7-5b390b5e5588 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:49.476952 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-be85f73d-6660-4cb4-9fa7-5b390b5e5588 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:49.477658 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-be85f73d-6660-4cb4-9fa7-5b390b5e5588 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:49.602621 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-801ad18e-ca4a-4dc5-a977-fae8883a3045 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81aa9d47cd1470abef31a27839eaf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8abe616c14a4920b1cbc45733fa5771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:38:49.622664 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-be85f73d-6660-4cb4-9fa7-5b390b5e5588 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72419918d6c34080b6a4a4c73b2c06b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b272349089480984fd1c5eabe6dce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:38:49.623089 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-801ad18e-ca4a-4dc5-a977-fae8883a3045 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] 10.222.0.57 "GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb" status: 200 len: 1569 microversion: 2.1 time: 0.380098 Jun 30 12:38:49.636298 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 308/627] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:38:49 2022] GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb => generated 1569 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:38:49.643583 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-be85f73d-6660-4cb4-9fa7-5b390b5e5588 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] 10.222.0.57 "GET /compute/v2.1/servers/ad5ae807-1a12-48f7-b582-d2ffe80d6cb1" status: 200 len: 1210 microversion: 2.1 time: 0.183401 Jun 30 12:38:49.645591 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 320/628] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:38:49 2022] GET /compute/v2.1/servers/ad5ae807-1a12-48f7-b582-d2ffe80d6cb1 => generated 1210 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:38:50.640351 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-b6e1069e-ad11-428e-8b8d-87a471793b41 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:50.641662 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-b6e1069e-ad11-428e-8b8d-87a471793b41 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] [instance: 17ef4273-4c60-498a-9061-2c4fbedbafdb] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:50.662671 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-74151f9b-8a4d-4d93-9d59-cd2794c4f610 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:50.663424 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-b6e1069e-ad11-428e-8b8d-87a471793b41 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:50.663889 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-b6e1069e-ad11-428e-8b8d-87a471793b41 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:50.664213 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-74151f9b-8a4d-4d93-9d59-cd2794c4f610 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] [instance: ad5ae807-1a12-48f7-b582-d2ffe80d6cb1] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:50.664793 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-b6e1069e-ad11-428e-8b8d-87a471793b41 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:50.665267 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-b6e1069e-ad11-428e-8b8d-87a471793b41 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:50.671471 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-74151f9b-8a4d-4d93-9d59-cd2794c4f610 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:50.672195 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-74151f9b-8a4d-4d93-9d59-cd2794c4f610 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:50.673153 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-74151f9b-8a4d-4d93-9d59-cd2794c4f610 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:50.673751 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-74151f9b-8a4d-4d93-9d59-cd2794c4f610 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:50.886685 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-74151f9b-8a4d-4d93-9d59-cd2794c4f610 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72419918d6c34080b6a4a4c73b2c06b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b272349089480984fd1c5eabe6dce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:38:50.896015 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-74151f9b-8a4d-4d93-9d59-cd2794c4f610 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] 10.222.0.57 "GET /compute/v2.1/servers/ad5ae807-1a12-48f7-b582-d2ffe80d6cb1" status: 200 len: 1265 microversion: 2.1 time: 0.237739 Jun 30 12:38:50.897272 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 321/629] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:38:50 2022] GET /compute/v2.1/servers/ad5ae807-1a12-48f7-b582-d2ffe80d6cb1 => generated 1265 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:38:50.910458 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-b6e1069e-ad11-428e-8b8d-87a471793b41 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81aa9d47cd1470abef31a27839eaf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8abe616c14a4920b1cbc45733fa5771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:38:50.919324 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-b6e1069e-ad11-428e-8b8d-87a471793b41 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] 10.222.0.57 "GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb" status: 200 len: 1569 microversion: 2.1 time: 0.282811 Jun 30 12:38:50.930505 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 309/630] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:38:50 2022] GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb => generated 1569 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:38:51.091503 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-c21dc2a1-e507-4216-82e7-0b18827d2a70 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Action: 'create', calling method: .version_select at 0x7fd0e0071c10>, body: {"keypair": {"name": "tempest-keypair-2090490146", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLIm/5P/m+kjfKVfA6kkz9N+N3HVXkmFHRKc+3GHEdl+5ik1lBBA4dHNCobt9ZmeMKxkuSKSbdBc9GugIHygWw/nI191QmSZQ6tYgFyWkNEREC+Urv6uquvajxGyhI83ZA=="}} {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:38:51.112006 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.quota [None req-c21dc2a1-e507-4216-82e7-0b18827d2a70 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Getting quotas for project 373556d3416e4db68d08897c3d7c0a54. Resources: {'key_pairs'} {{(pid=124297) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 12:38:51.118515 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.quota [None req-c21dc2a1-e507-4216-82e7-0b18827d2a70 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Getting quotas for user 7294e5eafdfc42fbac105cf58ee07b70 and project 373556d3416e4db68d08897c3d7c0a54. Resources: {'key_pairs'} {{(pid=124297) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 12:38:51.155879 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-c21dc2a1-e507-4216-82e7-0b18827d2a70 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.257263 Jun 30 12:38:51.156741 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 322/631] 10.222.0.57 () {62 vars in 1199 bytes} [Thu Jun 30 12:38:50 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 259 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 30 12:38:51.350603 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [req-c5e6a635-afa7-4b96-a131-333f7f46e964 req-90cdf329-9266-41c5-bd34-4b23be5f6dbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad5ae807-1a12-48f7-b582-d2ffe80d6cb1", "tag": "6b9d37a9-15f5-46c2-b4ca-f8fa374974dd"}]} {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:38:51.367978 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [req-c5e6a635-afa7-4b96-a131-333f7f46e964 req-90cdf329-9266-41c5-bd34-4b23be5f6dbe service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:51.369524 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [req-c5e6a635-afa7-4b96-a131-333f7f46e964 req-90cdf329-9266-41c5-bd34-4b23be5f6dbe service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:51.388711 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.compute.server_external_events [req-c5e6a635-afa7-4b96-a131-333f7f46e964 req-90cdf329-9266-41c5-bd34-4b23be5f6dbe service nova] Creating event network-changed:6b9d37a9-15f5-46c2-b4ca-f8fa374974dd for instance ad5ae807-1a12-48f7-b582-d2ffe80d6cb1 on hv-cinder-84614 Jun 30 12:38:51.395664 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [req-c5e6a635-afa7-4b96-a131-333f7f46e964 req-90cdf329-9266-41c5-bd34-4b23be5f6dbe service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049723 Jun 30 12:38:51.396276 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 310/632] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 30 12:38:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:38:51.914904 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-7b27ade5-67ef-460e-a83f-2373ac48f520 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:51.915622 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-7b27ade5-67ef-460e-a83f-2373ac48f520 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] [instance: ad5ae807-1a12-48f7-b582-d2ffe80d6cb1] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:51.923499 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-7b27ade5-67ef-460e-a83f-2373ac48f520 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:51.923953 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-7b27ade5-67ef-460e-a83f-2373ac48f520 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:51.924862 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-7b27ade5-67ef-460e-a83f-2373ac48f520 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:51.925643 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-7b27ade5-67ef-460e-a83f-2373ac48f520 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:51.930105 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG dbcounter [-] [124297] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:51.937902 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-4f4646fe-5545-4695-8cf4-47e8bb86ae91 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:51.940182 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-4f4646fe-5545-4695-8cf4-47e8bb86ae91 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] [instance: 17ef4273-4c60-498a-9061-2c4fbedbafdb] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:51.968265 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-4f4646fe-5545-4695-8cf4-47e8bb86ae91 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:51.968584 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-4f4646fe-5545-4695-8cf4-47e8bb86ae91 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:51.973365 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-4f4646fe-5545-4695-8cf4-47e8bb86ae91 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:51.973869 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-4f4646fe-5545-4695-8cf4-47e8bb86ae91 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:52.294612 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-7b27ade5-67ef-460e-a83f-2373ac48f520 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72419918d6c34080b6a4a4c73b2c06b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b272349089480984fd1c5eabe6dce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:38:52.303296 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-7b27ade5-67ef-460e-a83f-2373ac48f520 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] 10.222.0.57 "GET /compute/v2.1/servers/ad5ae807-1a12-48f7-b582-d2ffe80d6cb1" status: 200 len: 1265 microversion: 2.1 time: 0.392996 Jun 30 12:38:52.304217 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 323/633] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:38:51 2022] GET /compute/v2.1/servers/ad5ae807-1a12-48f7-b582-d2ffe80d6cb1 => generated 1265 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:38:52.320640 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-4f4646fe-5545-4695-8cf4-47e8bb86ae91 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81aa9d47cd1470abef31a27839eaf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8abe616c14a4920b1cbc45733fa5771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:38:52.329684 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-4f4646fe-5545-4695-8cf4-47e8bb86ae91 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] 10.222.0.57 "GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb" status: 200 len: 1569 microversion: 2.1 time: 0.396152 Jun 30 12:38:52.330462 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 311/634] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:38:51 2022] GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb => generated 1569 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 12:38:53.020928 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-edfbf8e7-6c36-439c-a509-f3c8930aed09 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-451969254", "imageRef": "776a1662-a241-4e20-9a9c-e4743c64efd0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ea811a85-2dc6-4699-af53-031270ac60e2"}], "security_groups": [{"name": "tempest-securitygroup--264698487"}], "key_name": "tempest-keypair-2090490146", "user_data": "}} {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:38:53.139390 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.network.neutron [None req-edfbf8e7-6c36-439c-a509-f3c8930aed09 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] validate_networks() for [('ea811a85-2dc6-4699-af53-031270ac60e2', None, None, None, None, None)] {{(pid=124297) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 12:38:53.321380 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-ead27d0b-688f-433f-a299-1a1b4e64e420 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:53.322631 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-ead27d0b-688f-433f-a299-1a1b4e64e420 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] [instance: ad5ae807-1a12-48f7-b582-d2ffe80d6cb1] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:53.329659 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-ead27d0b-688f-433f-a299-1a1b4e64e420 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:53.330429 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-ead27d0b-688f-433f-a299-1a1b4e64e420 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:53.331312 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-ead27d0b-688f-433f-a299-1a1b4e64e420 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:53.332079 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-ead27d0b-688f-433f-a299-1a1b4e64e420 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:53.845814 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-ead27d0b-688f-433f-a299-1a1b4e64e420 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72419918d6c34080b6a4a4c73b2c06b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b272349089480984fd1c5eabe6dce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:38:53.854299 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-ead27d0b-688f-433f-a299-1a1b4e64e420 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] 10.222.0.57 "GET /compute/v2.1/servers/ad5ae807-1a12-48f7-b582-d2ffe80d6cb1" status: 200 len: 1265 microversion: 2.1 time: 0.537104 Jun 30 12:38:53.865296 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 312/635] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:38:53 2022] GET /compute/v2.1/servers/ad5ae807-1a12-48f7-b582-d2ffe80d6cb1 => generated 1265 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:38:53.874202 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-33111ba4-7368-4278-8f26-4d27e32a9624 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:53.875002 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-33111ba4-7368-4278-8f26-4d27e32a9624 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] [instance: 17ef4273-4c60-498a-9061-2c4fbedbafdb] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:53.882068 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-33111ba4-7368-4278-8f26-4d27e32a9624 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:53.882844 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-33111ba4-7368-4278-8f26-4d27e32a9624 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:53.883872 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-33111ba4-7368-4278-8f26-4d27e32a9624 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:53.884517 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-33111ba4-7368-4278-8f26-4d27e32a9624 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:53.995452 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.virt.hardware [None req-edfbf8e7-6c36-439c-a509-f3c8930aed09 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Flavor limits 0:0:0 {{(pid=124297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 12:38:53.997312 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.virt.hardware [None req-edfbf8e7-6c36-439c-a509-f3c8930aed09 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Image limits 0:0:0 {{(pid=124297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 12:38:53.998039 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.virt.hardware [None req-edfbf8e7-6c36-439c-a509-f3c8930aed09 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Flavor pref 0:0:0 {{(pid=124297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 12:38:53.999399 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.virt.hardware [None req-edfbf8e7-6c36-439c-a509-f3c8930aed09 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Image pref 0:0:0 {{(pid=124297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 12:38:54.000460 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.virt.hardware [None req-edfbf8e7-6c36-439c-a509-f3c8930aed09 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 12:38:54.026375 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-edfbf8e7-6c36-439c-a509-f3c8930aed09 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:54.027651 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-edfbf8e7-6c36-439c-a509-f3c8930aed09 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:54.028893 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-edfbf8e7-6c36-439c-a509-f3c8930aed09 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:54.030164 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-edfbf8e7-6c36-439c-a509-f3c8930aed09 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:54.057878 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.quota [None req-edfbf8e7-6c36-439c-a509-f3c8930aed09 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Getting quotas for project 373556d3416e4db68d08897c3d7c0a54. Resources: {'cores', 'ram', 'instances'} {{(pid=124297) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 12:38:54.063408 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.quota [None req-edfbf8e7-6c36-439c-a509-f3c8930aed09 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Getting quotas for user 7294e5eafdfc42fbac105cf58ee07b70 and project 373556d3416e4db68d08897c3d7c0a54. Resources: {'cores', 'ram', 'instances'} {{(pid=124297) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 12:38:54.082161 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-33111ba4-7368-4278-8f26-4d27e32a9624 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81aa9d47cd1470abef31a27839eaf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8abe616c14a4920b1cbc45733fa5771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:38:54.095101 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-33111ba4-7368-4278-8f26-4d27e32a9624 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] 10.222.0.57 "GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb" status: 200 len: 1569 microversion: 2.1 time: 0.228065 Jun 30 12:38:54.095876 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 313/636] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:38:53 2022] GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb => generated 1569 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:38:54.100350 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-edfbf8e7-6c36-439c-a509-f3c8930aed09 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Going to run 1 instances... {{(pid=124297) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 12:38:54.106039 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-edfbf8e7-6c36-439c-a509-f3c8930aed09 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: 8d6c9ce4-3de7-47d1-8e5a-1abe9091129e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='776a1662-a241-4e20-9a9c-e4743c64efd0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124297) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 12:38:54.162041 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-edfbf8e7-6c36-439c-a509-f3c8930aed09 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.145670 Jun 30 12:38:54.164821 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 324/637] 10.222.0.57 () {62 vars in 1187 bytes} [Thu Jun 30 12:38:53 2022] POST /compute/v2.1/servers => generated 401 bytes in 1149 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 30 12:38:54.174300 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-be5f4247-7942-4b23-8f12-70857922104d tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:54.174929 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-be5f4247-7942-4b23-8f12-70857922104d tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: 8d6c9ce4-3de7-47d1-8e5a-1abe9091129e] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:54.255484 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-be5f4247-7942-4b23-8f12-70857922104d tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:38:54.269207 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-be5f4247-7942-4b23-8f12-70857922104d tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:38:54.272476 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-be5f4247-7942-4b23-8f12-70857922104d tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:38:54.274202 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-be5f4247-7942-4b23-8f12-70857922104d tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e" status: 200 len: 1281 microversion: 2.20 time: 0.104724 Jun 30 12:38:54.281703 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 314/638] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:38:54 2022] GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e => generated 1281 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:38:54.875130 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-3c483467-f8f4-4216-bd45-d5a44d43a99d tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:54.876126 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-3c483467-f8f4-4216-bd45-d5a44d43a99d tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] [instance: ad5ae807-1a12-48f7-b582-d2ffe80d6cb1] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:54.887741 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-3c483467-f8f4-4216-bd45-d5a44d43a99d tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:54.888410 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-3c483467-f8f4-4216-bd45-d5a44d43a99d tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:54.889678 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-3c483467-f8f4-4216-bd45-d5a44d43a99d tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:54.890387 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-3c483467-f8f4-4216-bd45-d5a44d43a99d tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:55.030659 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-3c483467-f8f4-4216-bd45-d5a44d43a99d tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72419918d6c34080b6a4a4c73b2c06b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b272349089480984fd1c5eabe6dce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:38:55.042378 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-3c483467-f8f4-4216-bd45-d5a44d43a99d tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] 10.222.0.57 "GET /compute/v2.1/servers/ad5ae807-1a12-48f7-b582-d2ffe80d6cb1" status: 200 len: 1265 microversion: 2.1 time: 0.173591 Jun 30 12:38:55.043140 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 325/639] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:38:54 2022] GET /compute/v2.1/servers/ad5ae807-1a12-48f7-b582-d2ffe80d6cb1 => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:38:55.113522 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-fead4b4c-1747-44a7-8b7e-514489220591 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:55.114286 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-fead4b4c-1747-44a7-8b7e-514489220591 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] [instance: 17ef4273-4c60-498a-9061-2c4fbedbafdb] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:55.122124 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-fead4b4c-1747-44a7-8b7e-514489220591 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:55.122572 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-fead4b4c-1747-44a7-8b7e-514489220591 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:55.123341 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-fead4b4c-1747-44a7-8b7e-514489220591 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:55.123775 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-fead4b4c-1747-44a7-8b7e-514489220591 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:55.260285 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-fead4b4c-1747-44a7-8b7e-514489220591 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81aa9d47cd1470abef31a27839eaf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8abe616c14a4920b1cbc45733fa5771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:38:55.268079 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-fead4b4c-1747-44a7-8b7e-514489220591 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] 10.222.0.57 "GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb" status: 200 len: 1569 microversion: 2.1 time: 0.158814 Jun 30 12:38:55.268726 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 315/640] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:38:55 2022] GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:38:55.293919 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-964c52e0-f55e-4f8f-96ce-315da0935564 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:55.294521 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-964c52e0-f55e-4f8f-96ce-315da0935564 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: 8d6c9ce4-3de7-47d1-8e5a-1abe9091129e] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:55.301055 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-964c52e0-f55e-4f8f-96ce-315da0935564 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:55.301880 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-964c52e0-f55e-4f8f-96ce-315da0935564 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:55.302644 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-964c52e0-f55e-4f8f-96ce-315da0935564 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:55.303082 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-964c52e0-f55e-4f8f-96ce-315da0935564 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:55.369442 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-964c52e0-f55e-4f8f-96ce-315da0935564 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:38:55.377706 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-964c52e0-f55e-4f8f-96ce-315da0935564 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:38:55.379379 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-964c52e0-f55e-4f8f-96ce-315da0935564 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:38:55.380495 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-964c52e0-f55e-4f8f-96ce-315da0935564 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e" status: 200 len: 1285 microversion: 2.20 time: 0.090488 Jun 30 12:38:55.381106 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 326/641] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:38:55 2022] GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e => generated 1285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:38:56.070714 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-85b827dc-9bbf-4676-b3e6-893f7d6585e1 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:56.071888 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-85b827dc-9bbf-4676-b3e6-893f7d6585e1 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] [instance: ad5ae807-1a12-48f7-b582-d2ffe80d6cb1] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:56.078997 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-85b827dc-9bbf-4676-b3e6-893f7d6585e1 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:56.079443 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-85b827dc-9bbf-4676-b3e6-893f7d6585e1 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:56.080212 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-85b827dc-9bbf-4676-b3e6-893f7d6585e1 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:56.080710 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-85b827dc-9bbf-4676-b3e6-893f7d6585e1 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:56.230661 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-85b827dc-9bbf-4676-b3e6-893f7d6585e1 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72419918d6c34080b6a4a4c73b2c06b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b272349089480984fd1c5eabe6dce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:38:56.238485 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-85b827dc-9bbf-4676-b3e6-893f7d6585e1 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] 10.222.0.57 "GET /compute/v2.1/servers/ad5ae807-1a12-48f7-b582-d2ffe80d6cb1" status: 200 len: 1265 microversion: 2.1 time: 0.173551 Jun 30 12:38:56.239056 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 316/642] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:38:56 2022] GET /compute/v2.1/servers/ad5ae807-1a12-48f7-b582-d2ffe80d6cb1 => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:38:56.286422 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-53a62f10-d569-409e-b482-c66aab4dac53 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:56.287085 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-53a62f10-d569-409e-b482-c66aab4dac53 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] [instance: 17ef4273-4c60-498a-9061-2c4fbedbafdb] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:56.303431 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-53a62f10-d569-409e-b482-c66aab4dac53 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:56.303876 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-53a62f10-d569-409e-b482-c66aab4dac53 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:56.304686 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-53a62f10-d569-409e-b482-c66aab4dac53 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:56.305115 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-53a62f10-d569-409e-b482-c66aab4dac53 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:56.399524 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-ef3c5294-9275-4b3b-9f3a-94a255fb21a3 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:56.400326 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-ef3c5294-9275-4b3b-9f3a-94a255fb21a3 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: 8d6c9ce4-3de7-47d1-8e5a-1abe9091129e] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:56.407151 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-ef3c5294-9275-4b3b-9f3a-94a255fb21a3 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:56.407647 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-ef3c5294-9275-4b3b-9f3a-94a255fb21a3 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:56.408421 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-ef3c5294-9275-4b3b-9f3a-94a255fb21a3 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:56.409632 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-ef3c5294-9275-4b3b-9f3a-94a255fb21a3 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:56.415482 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG dbcounter [-] [124298] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:56.464744 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-53a62f10-d569-409e-b482-c66aab4dac53 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81aa9d47cd1470abef31a27839eaf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8abe616c14a4920b1cbc45733fa5771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:38:56.472570 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-53a62f10-d569-409e-b482-c66aab4dac53 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] 10.222.0.57 "GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb" status: 200 len: 1569 microversion: 2.1 time: 0.190622 Jun 30 12:38:56.473435 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 327/643] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:38:56 2022] GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb => generated 1569 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:38:56.482918 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-ef3c5294-9275-4b3b-9f3a-94a255fb21a3 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:38:56.489881 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-ef3c5294-9275-4b3b-9f3a-94a255fb21a3 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:38:56.491513 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-ef3c5294-9275-4b3b-9f3a-94a255fb21a3 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:38:56.492842 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-ef3c5294-9275-4b3b-9f3a-94a255fb21a3 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e" status: 200 len: 1333 microversion: 2.20 time: 0.097724 Jun 30 12:38:56.493505 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 317/644] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:38:56 2022] GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e => generated 1333 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:38:57.256190 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-d0d3f895-aec5-443f-8e12-950fde23a794 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:57.256833 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-d0d3f895-aec5-443f-8e12-950fde23a794 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] [instance: ad5ae807-1a12-48f7-b582-d2ffe80d6cb1] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:57.263434 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-d0d3f895-aec5-443f-8e12-950fde23a794 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:57.263887 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-d0d3f895-aec5-443f-8e12-950fde23a794 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:57.264659 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-d0d3f895-aec5-443f-8e12-950fde23a794 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:57.265115 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-d0d3f895-aec5-443f-8e12-950fde23a794 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:57.403876 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-d0d3f895-aec5-443f-8e12-950fde23a794 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72419918d6c34080b6a4a4c73b2c06b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b272349089480984fd1c5eabe6dce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:38:57.412229 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-d0d3f895-aec5-443f-8e12-950fde23a794 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] 10.222.0.57 "GET /compute/v2.1/servers/ad5ae807-1a12-48f7-b582-d2ffe80d6cb1" status: 200 len: 1265 microversion: 2.1 time: 0.161159 Jun 30 12:38:57.412876 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 328/645] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:38:57 2022] GET /compute/v2.1/servers/ad5ae807-1a12-48f7-b582-d2ffe80d6cb1 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:38:57.490677 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-7142cb0f-f691-4d0c-ae42-711d1f9ad2d0 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:57.491308 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-7142cb0f-f691-4d0c-ae42-711d1f9ad2d0 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] [instance: 17ef4273-4c60-498a-9061-2c4fbedbafdb] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:57.498696 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-7142cb0f-f691-4d0c-ae42-711d1f9ad2d0 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:57.499156 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-7142cb0f-f691-4d0c-ae42-711d1f9ad2d0 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:57.499942 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-7142cb0f-f691-4d0c-ae42-711d1f9ad2d0 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:57.500369 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-7142cb0f-f691-4d0c-ae42-711d1f9ad2d0 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:57.511380 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-2a06e9ef-17ee-43de-bcac-d0e7e1ea4c6e tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:57.512150 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-2a06e9ef-17ee-43de-bcac-d0e7e1ea4c6e tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: 8d6c9ce4-3de7-47d1-8e5a-1abe9091129e] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:57.519670 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-2a06e9ef-17ee-43de-bcac-d0e7e1ea4c6e tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:57.520746 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-2a06e9ef-17ee-43de-bcac-d0e7e1ea4c6e tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:57.521746 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-2a06e9ef-17ee-43de-bcac-d0e7e1ea4c6e tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:57.522540 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-2a06e9ef-17ee-43de-bcac-d0e7e1ea4c6e tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:57.701984 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-7142cb0f-f691-4d0c-ae42-711d1f9ad2d0 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81aa9d47cd1470abef31a27839eaf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8abe616c14a4920b1cbc45733fa5771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:38:57.711726 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-7142cb0f-f691-4d0c-ae42-711d1f9ad2d0 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] 10.222.0.57 "GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb" status: 200 len: 1569 microversion: 2.1 time: 0.224993 Jun 30 12:38:57.721428 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 318/646] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:38:57 2022] GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb => generated 1569 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:38:57.733350 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-2a06e9ef-17ee-43de-bcac-d0e7e1ea4c6e tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:38:57.744057 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-2a06e9ef-17ee-43de-bcac-d0e7e1ea4c6e tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:38:57.745696 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-2a06e9ef-17ee-43de-bcac-d0e7e1ea4c6e tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:38:57.746934 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-2a06e9ef-17ee-43de-bcac-d0e7e1ea4c6e tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e" status: 200 len: 1406 microversion: 2.20 time: 0.239551 Jun 30 12:38:57.747604 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 329/647] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:38:57 2022] GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e => generated 1406 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:38:58.369948 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [req-b4fd1db3-9f3f-4425-9d67-108cc9bc0bbd req-bae09976-61ba-4e50-8053-e98a5e0920ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d6c9ce4-3de7-47d1-8e5a-1abe9091129e", "tag": "f52ef586-26d4-4590-b973-a09504ba1350"}]} {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:38:58.383570 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [req-b4fd1db3-9f3f-4425-9d67-108cc9bc0bbd req-bae09976-61ba-4e50-8053-e98a5e0920ad service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:58.384301 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [req-b4fd1db3-9f3f-4425-9d67-108cc9bc0bbd req-bae09976-61ba-4e50-8053-e98a5e0920ad service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:58.397103 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.compute.server_external_events [req-b4fd1db3-9f3f-4425-9d67-108cc9bc0bbd req-bae09976-61ba-4e50-8053-e98a5e0920ad service nova] Creating event network-changed:f52ef586-26d4-4590-b973-a09504ba1350 for instance 8d6c9ce4-3de7-47d1-8e5a-1abe9091129e on hv-cinder-84614 Jun 30 12:38:58.417334 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [req-b4fd1db3-9f3f-4425-9d67-108cc9bc0bbd req-bae09976-61ba-4e50-8053-e98a5e0920ad service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051603 Jun 30 12:38:58.417998 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 319/648] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 30 12:38:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:38:58.429000 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-44f46663-69fb-476b-9e99-63597d6aaecf tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:58.429675 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-44f46663-69fb-476b-9e99-63597d6aaecf tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] [instance: ad5ae807-1a12-48f7-b582-d2ffe80d6cb1] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:58.440160 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-44f46663-69fb-476b-9e99-63597d6aaecf tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:58.440613 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-44f46663-69fb-476b-9e99-63597d6aaecf tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:58.441463 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-44f46663-69fb-476b-9e99-63597d6aaecf tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:58.441898 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-44f46663-69fb-476b-9e99-63597d6aaecf tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:58.581656 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-44f46663-69fb-476b-9e99-63597d6aaecf tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72419918d6c34080b6a4a4c73b2c06b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b272349089480984fd1c5eabe6dce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:38:58.591663 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-44f46663-69fb-476b-9e99-63597d6aaecf tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] 10.222.0.57 "GET /compute/v2.1/servers/ad5ae807-1a12-48f7-b582-d2ffe80d6cb1" status: 200 len: 1265 microversion: 2.1 time: 0.166841 Jun 30 12:38:58.596429 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 330/649] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:38:58 2022] GET /compute/v2.1/servers/ad5ae807-1a12-48f7-b582-d2ffe80d6cb1 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:38:58.738424 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-8d4d89ad-e991-43f4-ae8b-8b2be990511e tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:58.739241 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-8d4d89ad-e991-43f4-ae8b-8b2be990511e tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] [instance: 17ef4273-4c60-498a-9061-2c4fbedbafdb] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:58.745652 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-8d4d89ad-e991-43f4-ae8b-8b2be990511e tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:58.746113 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-8d4d89ad-e991-43f4-ae8b-8b2be990511e tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:58.746878 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-8d4d89ad-e991-43f4-ae8b-8b2be990511e tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:58.747299 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-8d4d89ad-e991-43f4-ae8b-8b2be990511e tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:58.771552 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-aecf742d-3650-4289-b427-fc8bfde0106e tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:58.772159 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-aecf742d-3650-4289-b427-fc8bfde0106e tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: 8d6c9ce4-3de7-47d1-8e5a-1abe9091129e] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:58.779394 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-aecf742d-3650-4289-b427-fc8bfde0106e tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:58.780287 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-aecf742d-3650-4289-b427-fc8bfde0106e tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:58.781289 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-aecf742d-3650-4289-b427-fc8bfde0106e tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:58.781910 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-aecf742d-3650-4289-b427-fc8bfde0106e tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:58.959939 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-8d4d89ad-e991-43f4-ae8b-8b2be990511e tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81aa9d47cd1470abef31a27839eaf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8abe616c14a4920b1cbc45733fa5771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:38:58.970042 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-8d4d89ad-e991-43f4-ae8b-8b2be990511e tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] 10.222.0.57 "GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb" status: 200 len: 1569 microversion: 2.1 time: 0.236003 Jun 30 12:38:58.970640 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 320/650] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:38:58 2022] GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb => generated 1569 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:38:58.973263 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-aecf742d-3650-4289-b427-fc8bfde0106e tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:38:58.985759 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-aecf742d-3650-4289-b427-fc8bfde0106e tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:38:58.987315 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-aecf742d-3650-4289-b427-fc8bfde0106e tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:38:58.988734 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-aecf742d-3650-4289-b427-fc8bfde0106e tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e" status: 200 len: 1406 microversion: 2.20 time: 0.221689 Jun 30 12:38:58.989286 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 331/651] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:38:58 2022] GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e => generated 1406 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:38:59.613841 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-b38fb7e8-1190-4a6f-9c58-4e35beb11a0b tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:59.615004 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-b38fb7e8-1190-4a6f-9c58-4e35beb11a0b tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] [instance: ad5ae807-1a12-48f7-b582-d2ffe80d6cb1] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:59.626534 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-b38fb7e8-1190-4a6f-9c58-4e35beb11a0b tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:59.627627 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-b38fb7e8-1190-4a6f-9c58-4e35beb11a0b tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:59.629215 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-b38fb7e8-1190-4a6f-9c58-4e35beb11a0b tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:59.630313 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-b38fb7e8-1190-4a6f-9c58-4e35beb11a0b tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:59.769294 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-b38fb7e8-1190-4a6f-9c58-4e35beb11a0b tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72419918d6c34080b6a4a4c73b2c06b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b272349089480984fd1c5eabe6dce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:38:59.777278 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-b38fb7e8-1190-4a6f-9c58-4e35beb11a0b tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] 10.222.0.57 "GET /compute/v2.1/servers/ad5ae807-1a12-48f7-b582-d2ffe80d6cb1" status: 200 len: 1265 microversion: 2.1 time: 0.170049 Jun 30 12:38:59.777856 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 321/652] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:38:59 2022] GET /compute/v2.1/servers/ad5ae807-1a12-48f7-b582-d2ffe80d6cb1 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:38:59.987585 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-58632142-6f15-42c3-88d0-d2709e332e4a tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:38:59.988365 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-58632142-6f15-42c3-88d0-d2709e332e4a tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] [instance: 17ef4273-4c60-498a-9061-2c4fbedbafdb] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:38:59.996415 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-58632142-6f15-42c3-88d0-d2709e332e4a tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:59.996944 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-58632142-6f15-42c3-88d0-d2709e332e4a tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:38:59.997715 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-58632142-6f15-42c3-88d0-d2709e332e4a tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:38:59.998148 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-58632142-6f15-42c3-88d0-d2709e332e4a tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:00.007778 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-547c8965-cb5a-4954-b028-d950567ffc44 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:39:00.008459 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-547c8965-cb5a-4954-b028-d950567ffc44 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: 8d6c9ce4-3de7-47d1-8e5a-1abe9091129e] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:39:00.014979 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-547c8965-cb5a-4954-b028-d950567ffc44 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:00.015757 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-547c8965-cb5a-4954-b028-d950567ffc44 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:00.016769 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-547c8965-cb5a-4954-b028-d950567ffc44 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:00.017403 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-547c8965-cb5a-4954-b028-d950567ffc44 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:00.223572 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-58632142-6f15-42c3-88d0-d2709e332e4a tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81aa9d47cd1470abef31a27839eaf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8abe616c14a4920b1cbc45733fa5771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:39:00.232154 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-58632142-6f15-42c3-88d0-d2709e332e4a tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] 10.222.0.57 "GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb" status: 200 len: 1569 microversion: 2.1 time: 0.248441 Jun 30 12:39:00.232779 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 332/653] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:38:59 2022] GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb => generated 1569 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:39:00.271495 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-547c8965-cb5a-4954-b028-d950567ffc44 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:39:00.279708 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-547c8965-cb5a-4954-b028-d950567ffc44 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:39:00.281198 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-547c8965-cb5a-4954-b028-d950567ffc44 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:39:00.283243 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-547c8965-cb5a-4954-b028-d950567ffc44 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e" status: 200 len: 1406 microversion: 2.20 time: 0.280130 Jun 30 12:39:00.284726 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 322/654] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:39:00 2022] GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e => generated 1406 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:39:00.795910 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-71a4fceb-0b79-47d3-9c59-fc9ca932d6ae tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:39:00.796511 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-71a4fceb-0b79-47d3-9c59-fc9ca932d6ae tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] [instance: ad5ae807-1a12-48f7-b582-d2ffe80d6cb1] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:39:00.803377 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-71a4fceb-0b79-47d3-9c59-fc9ca932d6ae tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:00.803820 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-71a4fceb-0b79-47d3-9c59-fc9ca932d6ae tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:00.804583 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-71a4fceb-0b79-47d3-9c59-fc9ca932d6ae tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:00.805040 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-71a4fceb-0b79-47d3-9c59-fc9ca932d6ae tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:01.006508 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-71a4fceb-0b79-47d3-9c59-fc9ca932d6ae tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72419918d6c34080b6a4a4c73b2c06b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b272349089480984fd1c5eabe6dce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:39:01.014337 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-71a4fceb-0b79-47d3-9c59-fc9ca932d6ae tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] 10.222.0.57 "GET /compute/v2.1/servers/ad5ae807-1a12-48f7-b582-d2ffe80d6cb1" status: 200 len: 1265 microversion: 2.1 time: 0.222313 Jun 30 12:39:01.014874 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 333/655] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:39:00 2022] GET /compute/v2.1/servers/ad5ae807-1a12-48f7-b582-d2ffe80d6cb1 => generated 1265 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:39:01.250165 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-546c6a54-ec6f-4388-b06b-d49985a78639 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:39:01.250846 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-546c6a54-ec6f-4388-b06b-d49985a78639 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] [instance: 17ef4273-4c60-498a-9061-2c4fbedbafdb] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:39:01.258096 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-546c6a54-ec6f-4388-b06b-d49985a78639 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:01.258999 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-546c6a54-ec6f-4388-b06b-d49985a78639 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:01.260779 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-546c6a54-ec6f-4388-b06b-d49985a78639 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:01.261440 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-546c6a54-ec6f-4388-b06b-d49985a78639 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:01.303387 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-303d8a74-4291-4a4b-b1f9-bba3201900ae tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:39:01.304214 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-303d8a74-4291-4a4b-b1f9-bba3201900ae tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: 8d6c9ce4-3de7-47d1-8e5a-1abe9091129e] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:39:01.314428 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-303d8a74-4291-4a4b-b1f9-bba3201900ae tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:01.315663 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-303d8a74-4291-4a4b-b1f9-bba3201900ae tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:01.316474 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-303d8a74-4291-4a4b-b1f9-bba3201900ae tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:01.316949 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-303d8a74-4291-4a4b-b1f9-bba3201900ae tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:01.459614 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-546c6a54-ec6f-4388-b06b-d49985a78639 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81aa9d47cd1470abef31a27839eaf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8abe616c14a4920b1cbc45733fa5771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:39:01.467746 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-546c6a54-ec6f-4388-b06b-d49985a78639 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] 10.222.0.57 "GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb" status: 200 len: 1569 microversion: 2.1 time: 0.221772 Jun 30 12:39:01.468615 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 323/656] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:39:01 2022] GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb => generated 1569 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:39:01.506100 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-303d8a74-4291-4a4b-b1f9-bba3201900ae tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:39:01.514241 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-303d8a74-4291-4a4b-b1f9-bba3201900ae tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:39:01.515820 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-303d8a74-4291-4a4b-b1f9-bba3201900ae tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:39:01.517168 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-303d8a74-4291-4a4b-b1f9-bba3201900ae tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e" status: 200 len: 1406 microversion: 2.20 time: 0.218332 Jun 30 12:39:01.517740 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 334/657] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:39:01 2022] GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e => generated 1406 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:39:02.032770 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-41401588-d6f7-4865-a4b3-89ddf51bcca7 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:39:02.033903 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-41401588-d6f7-4865-a4b3-89ddf51bcca7 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] [instance: ad5ae807-1a12-48f7-b582-d2ffe80d6cb1] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:39:02.041446 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-41401588-d6f7-4865-a4b3-89ddf51bcca7 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:02.041892 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-41401588-d6f7-4865-a4b3-89ddf51bcca7 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:02.042741 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-41401588-d6f7-4865-a4b3-89ddf51bcca7 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:02.043180 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-41401588-d6f7-4865-a4b3-89ddf51bcca7 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:02.181776 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-41401588-d6f7-4865-a4b3-89ddf51bcca7 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72419918d6c34080b6a4a4c73b2c06b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b272349089480984fd1c5eabe6dce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:39:02.189826 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-41401588-d6f7-4865-a4b3-89ddf51bcca7 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] 10.222.0.57 "GET /compute/v2.1/servers/ad5ae807-1a12-48f7-b582-d2ffe80d6cb1" status: 200 len: 1265 microversion: 2.1 time: 0.162397 Jun 30 12:39:02.190595 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 324/658] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:39:02 2022] GET /compute/v2.1/servers/ad5ae807-1a12-48f7-b582-d2ffe80d6cb1 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:39:02.485873 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-1e569c19-cf8f-4e00-aefa-690018d235d0 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:39:02.486608 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-1e569c19-cf8f-4e00-aefa-690018d235d0 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] [instance: 17ef4273-4c60-498a-9061-2c4fbedbafdb] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:39:02.493936 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-1e569c19-cf8f-4e00-aefa-690018d235d0 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:02.494388 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-1e569c19-cf8f-4e00-aefa-690018d235d0 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:02.495160 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-1e569c19-cf8f-4e00-aefa-690018d235d0 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:02.495800 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-1e569c19-cf8f-4e00-aefa-690018d235d0 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:02.535611 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-b611a008-5a03-4035-9daa-3b2bc697190e tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:39:02.536227 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-b611a008-5a03-4035-9daa-3b2bc697190e tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: 8d6c9ce4-3de7-47d1-8e5a-1abe9091129e] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:39:02.556112 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-b611a008-5a03-4035-9daa-3b2bc697190e tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:02.556938 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-b611a008-5a03-4035-9daa-3b2bc697190e tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:02.557942 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-b611a008-5a03-4035-9daa-3b2bc697190e tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:02.558443 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-b611a008-5a03-4035-9daa-3b2bc697190e tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:02.696540 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-1e569c19-cf8f-4e00-aefa-690018d235d0 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81aa9d47cd1470abef31a27839eaf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8abe616c14a4920b1cbc45733fa5771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:39:02.707173 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-1e569c19-cf8f-4e00-aefa-690018d235d0 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] 10.222.0.57 "GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb" status: 200 len: 1569 microversion: 2.1 time: 0.223880 Jun 30 12:39:02.708427 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 335/659] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:39:02 2022] GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb => generated 1569 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:39:02.730610 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-b611a008-5a03-4035-9daa-3b2bc697190e tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:39:02.738721 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-b611a008-5a03-4035-9daa-3b2bc697190e tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:39:02.740377 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-b611a008-5a03-4035-9daa-3b2bc697190e tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:39:02.741726 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-b611a008-5a03-4035-9daa-3b2bc697190e tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e" status: 200 len: 1406 microversion: 2.20 time: 0.210375 Jun 30 12:39:02.742381 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 325/660] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:39:02 2022] GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e => generated 1406 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:39:02.785196 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [req-56921c1b-6f37-4695-9a8f-10bd7d3d118f req-c391bb73-62b7-428b-8ab1-8a17877d71cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d6c9ce4-3de7-47d1-8e5a-1abe9091129e", "name": "network-vif-plugged", "status": "completed", "tag": "f52ef586-26d4-4590-b973-a09504ba1350"}]} {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:39:02.793872 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [req-56921c1b-6f37-4695-9a8f-10bd7d3d118f req-c391bb73-62b7-428b-8ab1-8a17877d71cc service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:02.794343 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [req-56921c1b-6f37-4695-9a8f-10bd7d3d118f req-c391bb73-62b7-428b-8ab1-8a17877d71cc service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:02.806266 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.compute.server_external_events [req-56921c1b-6f37-4695-9a8f-10bd7d3d118f req-c391bb73-62b7-428b-8ab1-8a17877d71cc service nova] Creating event network-vif-plugged:f52ef586-26d4-4590-b973-a09504ba1350 for instance 8d6c9ce4-3de7-47d1-8e5a-1abe9091129e on hv-cinder-84614 Jun 30 12:39:02.811613 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [req-56921c1b-6f37-4695-9a8f-10bd7d3d118f req-c391bb73-62b7-428b-8ab1-8a17877d71cc service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101192 Jun 30 12:39:02.812570 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 336/661] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 30 12:39:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:39:03.207393 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-3e65b2ac-42d7-41ca-8706-b58c876d76db tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:39:03.207992 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-3e65b2ac-42d7-41ca-8706-b58c876d76db tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] [instance: ad5ae807-1a12-48f7-b582-d2ffe80d6cb1] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:39:03.214995 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-3e65b2ac-42d7-41ca-8706-b58c876d76db tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:03.215441 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-3e65b2ac-42d7-41ca-8706-b58c876d76db tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:03.216203 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-3e65b2ac-42d7-41ca-8706-b58c876d76db tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:03.216661 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-3e65b2ac-42d7-41ca-8706-b58c876d76db tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:03.358429 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-3e65b2ac-42d7-41ca-8706-b58c876d76db tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72419918d6c34080b6a4a4c73b2c06b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b272349089480984fd1c5eabe6dce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:39:03.366198 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-3e65b2ac-42d7-41ca-8706-b58c876d76db tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] 10.222.0.57 "GET /compute/v2.1/servers/ad5ae807-1a12-48f7-b582-d2ffe80d6cb1" status: 200 len: 1265 microversion: 2.1 time: 0.162782 Jun 30 12:39:03.367329 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 326/662] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:39:03 2022] GET /compute/v2.1/servers/ad5ae807-1a12-48f7-b582-d2ffe80d6cb1 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:39:03.724738 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-093a24ba-e7cb-4726-9f36-99d8990a96b7 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:39:03.725438 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-093a24ba-e7cb-4726-9f36-99d8990a96b7 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] [instance: 17ef4273-4c60-498a-9061-2c4fbedbafdb] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:39:03.732237 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-093a24ba-e7cb-4726-9f36-99d8990a96b7 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:03.732977 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-093a24ba-e7cb-4726-9f36-99d8990a96b7 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:03.733465 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-093a24ba-e7cb-4726-9f36-99d8990a96b7 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:03.733897 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-093a24ba-e7cb-4726-9f36-99d8990a96b7 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:03.760285 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-18d079e9-5ae7-43ea-a196-0b86ccbc0b57 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:39:03.762030 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-18d079e9-5ae7-43ea-a196-0b86ccbc0b57 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: 8d6c9ce4-3de7-47d1-8e5a-1abe9091129e] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:39:03.781609 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-18d079e9-5ae7-43ea-a196-0b86ccbc0b57 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:03.782128 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-18d079e9-5ae7-43ea-a196-0b86ccbc0b57 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:03.782980 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-18d079e9-5ae7-43ea-a196-0b86ccbc0b57 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:03.783992 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-18d079e9-5ae7-43ea-a196-0b86ccbc0b57 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:03.931532 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-093a24ba-e7cb-4726-9f36-99d8990a96b7 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81aa9d47cd1470abef31a27839eaf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8abe616c14a4920b1cbc45733fa5771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:39:03.939620 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-093a24ba-e7cb-4726-9f36-99d8990a96b7 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] 10.222.0.57 "GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb" status: 200 len: 1569 microversion: 2.1 time: 0.219072 Jun 30 12:39:03.940215 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 337/663] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:39:03 2022] GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb => generated 1569 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:39:03.956363 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-18d079e9-5ae7-43ea-a196-0b86ccbc0b57 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:39:03.964886 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-18d079e9-5ae7-43ea-a196-0b86ccbc0b57 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:39:03.966412 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-18d079e9-5ae7-43ea-a196-0b86ccbc0b57 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:39:03.967533 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-18d079e9-5ae7-43ea-a196-0b86ccbc0b57 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e" status: 200 len: 1406 microversion: 2.20 time: 0.211555 Jun 30 12:39:03.968091 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 327/664] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:39:03 2022] GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e => generated 1406 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:39:04.387259 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-bf2e693b-72d7-4cf7-b7cf-4a152bf7c8c4 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:39:04.388072 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-bf2e693b-72d7-4cf7-b7cf-4a152bf7c8c4 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] [instance: ad5ae807-1a12-48f7-b582-d2ffe80d6cb1] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:39:04.391051 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG dbcounter [-] [124297] Writing DB stats nova_cell0:SELECT=4 {{(pid=124297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:39:04.392017 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG dbcounter [-] [124297] Writing DB stats nova_cell0:SELECT=16 {{(pid=124297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:39:04.400943 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-bf2e693b-72d7-4cf7-b7cf-4a152bf7c8c4 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:04.401395 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-bf2e693b-72d7-4cf7-b7cf-4a152bf7c8c4 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:04.402148 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-bf2e693b-72d7-4cf7-b7cf-4a152bf7c8c4 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:04.402588 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-bf2e693b-72d7-4cf7-b7cf-4a152bf7c8c4 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:04.546092 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-bf2e693b-72d7-4cf7-b7cf-4a152bf7c8c4 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72419918d6c34080b6a4a4c73b2c06b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b272349089480984fd1c5eabe6dce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:39:04.554145 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-bf2e693b-72d7-4cf7-b7cf-4a152bf7c8c4 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] 10.222.0.57 "GET /compute/v2.1/servers/ad5ae807-1a12-48f7-b582-d2ffe80d6cb1" status: 200 len: 1265 microversion: 2.1 time: 0.173094 Jun 30 12:39:04.554719 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 338/665] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:39:04 2022] GET /compute/v2.1/servers/ad5ae807-1a12-48f7-b582-d2ffe80d6cb1 => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:39:04.829297 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [req-0d0d2a06-52d0-423e-b15c-a9b328731fcb req-9a0b4fba-4009-4b3a-b292-258bc555ba00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad5ae807-1a12-48f7-b582-d2ffe80d6cb1", "name": "network-vif-plugged", "status": "completed", "tag": "6b9d37a9-15f5-46c2-b4ca-f8fa374974dd"}]} {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:39:04.832772 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG dbcounter [-] [124298] Writing DB stats nova_cell0:SELECT=4 {{(pid=124298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:39:04.840761 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [req-0d0d2a06-52d0-423e-b15c-a9b328731fcb req-9a0b4fba-4009-4b3a-b292-258bc555ba00 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:04.841212 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [req-0d0d2a06-52d0-423e-b15c-a9b328731fcb req-9a0b4fba-4009-4b3a-b292-258bc555ba00 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:04.852338 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.compute.server_external_events [req-0d0d2a06-52d0-423e-b15c-a9b328731fcb req-9a0b4fba-4009-4b3a-b292-258bc555ba00 service nova] Creating event network-vif-plugged:6b9d37a9-15f5-46c2-b4ca-f8fa374974dd for instance ad5ae807-1a12-48f7-b582-d2ffe80d6cb1 on hv-cinder-84614 Jun 30 12:39:04.857526 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [req-0d0d2a06-52d0-423e-b15c-a9b328731fcb req-9a0b4fba-4009-4b3a-b292-258bc555ba00 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032069 Jun 30 12:39:04.858508 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 328/666] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 30 12:39:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:39:04.957441 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-d5e194ba-0ed7-4ca0-92c6-714a52f0eba7 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:39:04.957979 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-d5e194ba-0ed7-4ca0-92c6-714a52f0eba7 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] [instance: 17ef4273-4c60-498a-9061-2c4fbedbafdb] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:39:04.964542 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-d5e194ba-0ed7-4ca0-92c6-714a52f0eba7 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:04.965103 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-d5e194ba-0ed7-4ca0-92c6-714a52f0eba7 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:04.965864 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-d5e194ba-0ed7-4ca0-92c6-714a52f0eba7 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:04.966295 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-d5e194ba-0ed7-4ca0-92c6-714a52f0eba7 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:04.992001 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-4dada2f8-1fb3-4749-81a0-583fb215f705 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:39:04.992001 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-4dada2f8-1fb3-4749-81a0-583fb215f705 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: 8d6c9ce4-3de7-47d1-8e5a-1abe9091129e] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:39:05.005390 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-4dada2f8-1fb3-4749-81a0-583fb215f705 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:05.015473 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-4dada2f8-1fb3-4749-81a0-583fb215f705 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:05.016546 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-4dada2f8-1fb3-4749-81a0-583fb215f705 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:05.017085 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-4dada2f8-1fb3-4749-81a0-583fb215f705 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:05.228396 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-d5e194ba-0ed7-4ca0-92c6-714a52f0eba7 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81aa9d47cd1470abef31a27839eaf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8abe616c14a4920b1cbc45733fa5771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:39:05.236272 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-d5e194ba-0ed7-4ca0-92c6-714a52f0eba7 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] 10.222.0.57 "GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb" status: 200 len: 1569 microversion: 2.1 time: 0.283465 Jun 30 12:39:05.236900 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 339/667] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:39:04 2022] GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb => generated 1569 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:39:05.258233 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-4dada2f8-1fb3-4749-81a0-583fb215f705 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:39:05.266258 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-4dada2f8-1fb3-4749-81a0-583fb215f705 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:39:05.267853 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-4dada2f8-1fb3-4749-81a0-583fb215f705 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:39:05.269127 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-4dada2f8-1fb3-4749-81a0-583fb215f705 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e" status: 200 len: 1598 microversion: 2.20 time: 0.287329 Jun 30 12:39:05.269732 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 329/668] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:39:04 2022] GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e => generated 1598 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 12:39:05.289336 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-41f7ff70-78ba-44b6-90c8-2088827bf9b5 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:39:05.289828 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-41f7ff70-78ba-44b6-90c8-2088827bf9b5 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: 8d6c9ce4-3de7-47d1-8e5a-1abe9091129e] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:39:05.296152 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-41f7ff70-78ba-44b6-90c8-2088827bf9b5 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:05.296586 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-41f7ff70-78ba-44b6-90c8-2088827bf9b5 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:05.297372 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-41f7ff70-78ba-44b6-90c8-2088827bf9b5 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:05.297805 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-41f7ff70-78ba-44b6-90c8-2088827bf9b5 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:05.379948 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-41f7ff70-78ba-44b6-90c8-2088827bf9b5 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.094716 Jun 30 12:39:05.380765 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 340/669] 10.222.0.57 () {60 vars in 1315 bytes} [Thu Jun 30 12:39:05 2022] GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 12:39:05.571964 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-85d5e60e-43ca-4484-b351-02ac8d9956e0 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:39:05.572452 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-85d5e60e-43ca-4484-b351-02ac8d9956e0 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] [instance: ad5ae807-1a12-48f7-b582-d2ffe80d6cb1] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:39:05.578904 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-85d5e60e-43ca-4484-b351-02ac8d9956e0 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:05.579345 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-85d5e60e-43ca-4484-b351-02ac8d9956e0 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:05.580109 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-85d5e60e-43ca-4484-b351-02ac8d9956e0 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:05.580560 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-85d5e60e-43ca-4484-b351-02ac8d9956e0 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:05.830411 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-85d5e60e-43ca-4484-b351-02ac8d9956e0 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72419918d6c34080b6a4a4c73b2c06b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b272349089480984fd1c5eabe6dce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:39:05.838525 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-85d5e60e-43ca-4484-b351-02ac8d9956e0 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] 10.222.0.57 "GET /compute/v2.1/servers/ad5ae807-1a12-48f7-b582-d2ffe80d6cb1" status: 200 len: 1265 microversion: 2.1 time: 0.270850 Jun 30 12:39:05.839187 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 330/670] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:39:05 2022] GET /compute/v2.1/servers/ad5ae807-1a12-48f7-b582-d2ffe80d6cb1 => generated 1265 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:39:06.254279 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-7eee8ac4-cb71-43e9-b646-2fd26751770a tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:39:06.255084 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-7eee8ac4-cb71-43e9-b646-2fd26751770a tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] [instance: 17ef4273-4c60-498a-9061-2c4fbedbafdb] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:39:06.257292 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG dbcounter [-] [124297] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=124297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:39:06.263801 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-7eee8ac4-cb71-43e9-b646-2fd26751770a tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:06.264439 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-7eee8ac4-cb71-43e9-b646-2fd26751770a tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:06.265377 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-7eee8ac4-cb71-43e9-b646-2fd26751770a tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:06.265949 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-7eee8ac4-cb71-43e9-b646-2fd26751770a tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:06.288409 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG dbcounter [-] [124297] Writing DB stats nova_cell1:SELECT=100 {{(pid=124297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:39:06.367068 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-5ecee437-34d4-4123-8b18-733288560218 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:39:06.367426 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-5ecee437-34d4-4123-8b18-733288560218 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 973c1877-9855-432d-819a-cdfcc917d844] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:39:06.375242 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-5ecee437-34d4-4123-8b18-733288560218 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:06.376309 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-5ecee437-34d4-4123-8b18-733288560218 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:06.377156 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-5ecee437-34d4-4123-8b18-733288560218 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:06.377576 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-5ecee437-34d4-4123-8b18-733288560218 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:06.406182 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-5ecee437-34d4-4123-8b18-733288560218 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/973c1877-9855-432d-819a-cdfcc917d844/ips" status: 200 len: 146 microversion: 2.1 time: 0.042752 Jun 30 12:39:06.411972 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 331/671] 10.222.0.57 () {58 vars in 1247 bytes} [Thu Jun 30 12:39:06 2022] GET /compute/v2.1/servers/973c1877-9855-432d-819a-cdfcc917d844/ips => generated 146 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:39:06.576132 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-7eee8ac4-cb71-43e9-b646-2fd26751770a tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81aa9d47cd1470abef31a27839eaf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8abe616c14a4920b1cbc45733fa5771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:39:06.590939 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-7eee8ac4-cb71-43e9-b646-2fd26751770a tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] 10.222.0.57 "GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb" status: 200 len: 1569 microversion: 2.1 time: 0.341004 Jun 30 12:39:06.591582 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 341/672] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:39:06 2022] GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb => generated 1569 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:39:06.784867 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [req-12d03d5b-9398-4dec-9145-72fc5d7aab35 req-ecdec4b0-9c4e-4925-98b3-3036795e30c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d6c9ce4-3de7-47d1-8e5a-1abe9091129e", "tag": "f52ef586-26d4-4590-b973-a09504ba1350"}]} {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:39:06.797348 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [req-12d03d5b-9398-4dec-9145-72fc5d7aab35 req-ecdec4b0-9c4e-4925-98b3-3036795e30c2 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:06.797945 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [req-12d03d5b-9398-4dec-9145-72fc5d7aab35 req-ecdec4b0-9c4e-4925-98b3-3036795e30c2 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:06.810771 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.compute.server_external_events [req-12d03d5b-9398-4dec-9145-72fc5d7aab35 req-ecdec4b0-9c4e-4925-98b3-3036795e30c2 service nova] Creating event network-changed:f52ef586-26d4-4590-b973-a09504ba1350 for instance 8d6c9ce4-3de7-47d1-8e5a-1abe9091129e on hv-cinder-84614 Jun 30 12:39:06.815763 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [req-12d03d5b-9398-4dec-9145-72fc5d7aab35 req-ecdec4b0-9c4e-4925-98b3-3036795e30c2 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034900 Jun 30 12:39:06.816362 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 332/673] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 30 12:39:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:39:06.856301 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-e246b680-995c-47ad-83fc-d2c47669c41c tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:39:06.856997 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-e246b680-995c-47ad-83fc-d2c47669c41c tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] [instance: ad5ae807-1a12-48f7-b582-d2ffe80d6cb1] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:39:06.866058 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-e246b680-995c-47ad-83fc-d2c47669c41c tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:06.866754 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-e246b680-995c-47ad-83fc-d2c47669c41c tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:06.867637 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-e246b680-995c-47ad-83fc-d2c47669c41c tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:06.868127 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-e246b680-995c-47ad-83fc-d2c47669c41c tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:07.035300 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-e246b680-995c-47ad-83fc-d2c47669c41c tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72419918d6c34080b6a4a4c73b2c06b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b272349089480984fd1c5eabe6dce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:39:07.044679 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-e246b680-995c-47ad-83fc-d2c47669c41c tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] 10.222.0.57 "GET /compute/v2.1/servers/ad5ae807-1a12-48f7-b582-d2ffe80d6cb1" status: 200 len: 1265 microversion: 2.1 time: 0.192882 Jun 30 12:39:07.045530 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 342/674] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:39:06 2022] GET /compute/v2.1/servers/ad5ae807-1a12-48f7-b582-d2ffe80d6cb1 => generated 1265 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 12:39:07.609684 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-30fe12b4-ceff-4d20-9837-357c4133ee1a tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:39:07.610395 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-30fe12b4-ceff-4d20-9837-357c4133ee1a tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] [instance: 17ef4273-4c60-498a-9061-2c4fbedbafdb] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:39:07.617753 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-30fe12b4-ceff-4d20-9837-357c4133ee1a tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:07.618216 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-30fe12b4-ceff-4d20-9837-357c4133ee1a tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:07.618993 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-30fe12b4-ceff-4d20-9837-357c4133ee1a tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:07.619466 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-30fe12b4-ceff-4d20-9837-357c4133ee1a tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:07.767354 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-30fe12b4-ceff-4d20-9837-357c4133ee1a tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81aa9d47cd1470abef31a27839eaf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8abe616c14a4920b1cbc45733fa5771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:39:07.775553 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-30fe12b4-ceff-4d20-9837-357c4133ee1a tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] 10.222.0.57 "GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb" status: 200 len: 1569 microversion: 2.1 time: 0.170480 Jun 30 12:39:07.776502 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 333/675] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:39:07 2022] GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb => generated 1569 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:39:07.792613 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-55c46d4a-883c-4e03-a6d4-0dc13914d151 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ae40f8d2-18c3-46b0-8da5-ff5f925b234e"}} {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:39:07.793764 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-55c46d4a-883c-4e03-a6d4-0dc13914d151 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 973c1877-9855-432d-819a-cdfcc917d844] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:39:07.800727 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-55c46d4a-883c-4e03-a6d4-0dc13914d151 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:07.801181 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-55c46d4a-883c-4e03-a6d4-0dc13914d151 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:07.801983 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-55c46d4a-883c-4e03-a6d4-0dc13914d151 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:07.802403 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-55c46d4a-883c-4e03-a6d4-0dc13914d151 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:08.061743 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-1e63ceff-859c-4df1-9e16-2a8d5647d822 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:39:08.062361 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-1e63ceff-859c-4df1-9e16-2a8d5647d822 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] [instance: ad5ae807-1a12-48f7-b582-d2ffe80d6cb1] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:39:08.080408 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-1e63ceff-859c-4df1-9e16-2a8d5647d822 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:08.081248 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-1e63ceff-859c-4df1-9e16-2a8d5647d822 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:08.082523 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-1e63ceff-859c-4df1-9e16-2a8d5647d822 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:08.082960 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-1e63ceff-859c-4df1-9e16-2a8d5647d822 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:08.191473 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-55c46d4a-883c-4e03-a6d4-0dc13914d151 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "POST /compute/v2.1/servers/973c1877-9855-432d-819a-cdfcc917d844/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.402746 Jun 30 12:39:08.192135 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 343/676] 10.222.0.57 () {60 vars in 1322 bytes} [Thu Jun 30 12:39:07 2022] POST /compute/v2.1/servers/973c1877-9855-432d-819a-cdfcc917d844/os-volume_attachments => generated 194 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:39:08.301345 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-1e63ceff-859c-4df1-9e16-2a8d5647d822 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72419918d6c34080b6a4a4c73b2c06b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b272349089480984fd1c5eabe6dce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:39:08.313378 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-1e63ceff-859c-4df1-9e16-2a8d5647d822 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] 10.222.0.57 "GET /compute/v2.1/servers/ad5ae807-1a12-48f7-b582-d2ffe80d6cb1" status: 200 len: 1452 microversion: 2.1 time: 0.255297 Jun 30 12:39:08.314400 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 334/677] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:39:08 2022] GET /compute/v2.1/servers/ad5ae807-1a12-48f7-b582-d2ffe80d6cb1 => generated 1452 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 12:39:08.338910 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-e0caf347-830c-418b-91f7-00f59388c387 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:39:08.339973 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-e0caf347-830c-418b-91f7-00f59388c387 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] [instance: ad5ae807-1a12-48f7-b582-d2ffe80d6cb1] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:39:08.347154 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-e0caf347-830c-418b-91f7-00f59388c387 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:08.347724 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-e0caf347-830c-418b-91f7-00f59388c387 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:08.348730 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-e0caf347-830c-418b-91f7-00f59388c387 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:08.349249 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-e0caf347-830c-418b-91f7-00f59388c387 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:08.562462 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-e0caf347-830c-418b-91f7-00f59388c387 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72419918d6c34080b6a4a4c73b2c06b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b272349089480984fd1c5eabe6dce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:39:08.571347 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-e0caf347-830c-418b-91f7-00f59388c387 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] 10.222.0.57 "GET /compute/v2.1/servers/ad5ae807-1a12-48f7-b582-d2ffe80d6cb1" status: 200 len: 1452 microversion: 2.1 time: 0.238317 Jun 30 12:39:08.571899 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 344/678] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:39:08 2022] GET /compute/v2.1/servers/ad5ae807-1a12-48f7-b582-d2ffe80d6cb1 => generated 1452 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 12:39:08.793398 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-9da500e7-5880-4ebb-9084-a11bf06c47a1 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:39:08.793994 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-9da500e7-5880-4ebb-9084-a11bf06c47a1 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] [instance: 17ef4273-4c60-498a-9061-2c4fbedbafdb] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:39:08.796929 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG dbcounter [-] [124298] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1 {{(pid=124298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:39:08.802605 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-9da500e7-5880-4ebb-9084-a11bf06c47a1 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:08.803049 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-9da500e7-5880-4ebb-9084-a11bf06c47a1 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:08.804063 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-9da500e7-5880-4ebb-9084-a11bf06c47a1 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:08.804491 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-9da500e7-5880-4ebb-9084-a11bf06c47a1 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:09.022874 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-9da500e7-5880-4ebb-9084-a11bf06c47a1 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81aa9d47cd1470abef31a27839eaf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8abe616c14a4920b1cbc45733fa5771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:39:09.030822 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-9da500e7-5880-4ebb-9084-a11bf06c47a1 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] 10.222.0.57 "GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb" status: 200 len: 1570 microversion: 2.1 time: 0.241523 Jun 30 12:39:09.031402 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 335/679] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:39:08 2022] GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb => generated 1570 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:39:09.048033 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-29dcb600-a814-4ea6-be25-ae689a4faec9 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:39:09.048592 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-29dcb600-a814-4ea6-be25-ae689a4faec9 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] [instance: 17ef4273-4c60-498a-9061-2c4fbedbafdb] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:39:09.055592 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-29dcb600-a814-4ea6-be25-ae689a4faec9 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:09.056126 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-29dcb600-a814-4ea6-be25-ae689a4faec9 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:09.056948 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-29dcb600-a814-4ea6-be25-ae689a4faec9 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:09.057461 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-29dcb600-a814-4ea6-be25-ae689a4faec9 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:09.156572 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-29dcb600-a814-4ea6-be25-ae689a4faec9 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] 10.222.0.57 "POST /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb/action" status: 202 len: 0 microversion: 2.1 time: 0.112471 Jun 30 12:39:09.157286 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 345/680] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Jun 30 12:39:09 2022] POST /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 12:39:09.166539 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-3f7be7d5-0a6b-4fda-91af-c2cd1a71fc14 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:39:09.167372 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-3f7be7d5-0a6b-4fda-91af-c2cd1a71fc14 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] [instance: 17ef4273-4c60-498a-9061-2c4fbedbafdb] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:39:09.175589 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-3f7be7d5-0a6b-4fda-91af-c2cd1a71fc14 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:09.176806 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-3f7be7d5-0a6b-4fda-91af-c2cd1a71fc14 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:09.177430 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-3f7be7d5-0a6b-4fda-91af-c2cd1a71fc14 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:09.178109 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-3f7be7d5-0a6b-4fda-91af-c2cd1a71fc14 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:09.185897 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG dbcounter [-] [124298] Writing DB stats nova_cell1:SELECT=100 {{(pid=124298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:39:09.449108 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-3f7be7d5-0a6b-4fda-91af-c2cd1a71fc14 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81aa9d47cd1470abef31a27839eaf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8abe616c14a4920b1cbc45733fa5771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:39:09.457095 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-3f7be7d5-0a6b-4fda-91af-c2cd1a71fc14 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] 10.222.0.57 "GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb" status: 200 len: 1518 microversion: 2.1 time: 0.295242 Jun 30 12:39:09.458033 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 336/681] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:39:09 2022] GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb => generated 1518 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 12:39:10.432423 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [req-9cbaa4eb-9bfa-4981-91ef-b1dd99259355 req-882cbd4d-7468-4eb9-b3b9-b31892c77928 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad5ae807-1a12-48f7-b582-d2ffe80d6cb1", "tag": "6b9d37a9-15f5-46c2-b4ca-f8fa374974dd"}]} {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:39:10.440846 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [req-9cbaa4eb-9bfa-4981-91ef-b1dd99259355 req-882cbd4d-7468-4eb9-b3b9-b31892c77928 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:10.441292 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [req-9cbaa4eb-9bfa-4981-91ef-b1dd99259355 req-882cbd4d-7468-4eb9-b3b9-b31892c77928 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:10.452417 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.compute.server_external_events [req-9cbaa4eb-9bfa-4981-91ef-b1dd99259355 req-882cbd4d-7468-4eb9-b3b9-b31892c77928 service nova] Creating event network-changed:6b9d37a9-15f5-46c2-b4ca-f8fa374974dd for instance ad5ae807-1a12-48f7-b582-d2ffe80d6cb1 on hv-cinder-84614 Jun 30 12:39:10.457542 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [req-9cbaa4eb-9bfa-4981-91ef-b1dd99259355 req-882cbd4d-7468-4eb9-b3b9-b31892c77928 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029459 Jun 30 12:39:10.458140 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 346/682] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 30 12:39:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:39:10.474608 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-52959f6d-a691-4009-87d9-e8f8fde0281c tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:39:10.475242 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-52959f6d-a691-4009-87d9-e8f8fde0281c tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] [instance: 17ef4273-4c60-498a-9061-2c4fbedbafdb] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:39:10.481790 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-52959f6d-a691-4009-87d9-e8f8fde0281c tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:10.482241 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-52959f6d-a691-4009-87d9-e8f8fde0281c tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:10.483012 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-52959f6d-a691-4009-87d9-e8f8fde0281c tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:10.483444 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-52959f6d-a691-4009-87d9-e8f8fde0281c tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:10.687550 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [req-f9201c35-e39e-4464-b5bd-3bd83b8633b9 req-94417161-fbe0-44a5-996b-e5a7ad161c25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17ef4273-4c60-498a-9061-2c4fbedbafdb", "name": "network-vif-unplugged", "status": "completed", "tag": "7fb1dbc5-fce3-4c9f-bb9e-b486d232eebc"}]} {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:39:10.697215 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [req-f9201c35-e39e-4464-b5bd-3bd83b8633b9 req-94417161-fbe0-44a5-996b-e5a7ad161c25 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:10.697631 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [req-f9201c35-e39e-4464-b5bd-3bd83b8633b9 req-94417161-fbe0-44a5-996b-e5a7ad161c25 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:10.709658 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-52959f6d-a691-4009-87d9-e8f8fde0281c tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81aa9d47cd1470abef31a27839eaf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8abe616c14a4920b1cbc45733fa5771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:39:10.709973 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.compute.server_external_events [req-f9201c35-e39e-4464-b5bd-3bd83b8633b9 req-94417161-fbe0-44a5-996b-e5a7ad161c25 service nova] Unable to find a host for instance 17ef4273-4c60-498a-9061-2c4fbedbafdb. Dropping event network-vif-unplugged {{(pid=124297) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 30 12:39:10.710734 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [req-f9201c35-e39e-4464-b5bd-3bd83b8633b9 req-94417161-fbe0-44a5-996b-e5a7ad161c25 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028210 Jun 30 12:39:10.712032 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 347/683] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 30 12:39:10 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 30 12:39:10.721521 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-52959f6d-a691-4009-87d9-e8f8fde0281c tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] 10.222.0.57 "GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb" status: 200 len: 1520 microversion: 2.1 time: 0.250757 Jun 30 12:39:10.722247 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 337/684] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:39:10 2022] GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb => generated 1520 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:39:11.740589 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-d7acdd8d-4b0e-4864-b6f7-d0fe5abd27a3 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:39:11.741256 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-d7acdd8d-4b0e-4864-b6f7-d0fe5abd27a3 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] [instance: 17ef4273-4c60-498a-9061-2c4fbedbafdb] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:39:11.748419 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-d7acdd8d-4b0e-4864-b6f7-d0fe5abd27a3 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:11.748900 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-d7acdd8d-4b0e-4864-b6f7-d0fe5abd27a3 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:11.749659 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-d7acdd8d-4b0e-4864-b6f7-d0fe5abd27a3 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:11.750086 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-d7acdd8d-4b0e-4864-b6f7-d0fe5abd27a3 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:11.888017 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-d7acdd8d-4b0e-4864-b6f7-d0fe5abd27a3 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81aa9d47cd1470abef31a27839eaf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8abe616c14a4920b1cbc45733fa5771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:39:11.896198 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-d7acdd8d-4b0e-4864-b6f7-d0fe5abd27a3 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] 10.222.0.57 "GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb" status: 200 len: 1520 microversion: 2.1 time: 0.159652 Jun 30 12:39:11.896822 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 348/685] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:39:11 2022] GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:39:12.917727 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-2a423b2c-c5b1-4656-939b-1a1aed29fe27 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:39:12.918288 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-2a423b2c-c5b1-4656-939b-1a1aed29fe27 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] [instance: 17ef4273-4c60-498a-9061-2c4fbedbafdb] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:39:12.925334 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-2a423b2c-c5b1-4656-939b-1a1aed29fe27 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:12.925816 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-2a423b2c-c5b1-4656-939b-1a1aed29fe27 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:12.926568 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-2a423b2c-c5b1-4656-939b-1a1aed29fe27 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:12.927018 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-2a423b2c-c5b1-4656-939b-1a1aed29fe27 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:13.062360 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-2a423b2c-c5b1-4656-939b-1a1aed29fe27 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81aa9d47cd1470abef31a27839eaf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8abe616c14a4920b1cbc45733fa5771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:39:13.070211 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-2a423b2c-c5b1-4656-939b-1a1aed29fe27 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] 10.222.0.57 "GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb" status: 200 len: 1520 microversion: 2.1 time: 0.158469 Jun 30 12:39:13.070781 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 338/686] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:39:12 2022] GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:39:14.086813 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-ae28aa4a-e7b1-474a-a644-21c04c3659a1 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:39:14.087416 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-ae28aa4a-e7b1-474a-a644-21c04c3659a1 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] [instance: 17ef4273-4c60-498a-9061-2c4fbedbafdb] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:39:14.095859 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-ae28aa4a-e7b1-474a-a644-21c04c3659a1 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:14.096336 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-ae28aa4a-e7b1-474a-a644-21c04c3659a1 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:14.097126 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-ae28aa4a-e7b1-474a-a644-21c04c3659a1 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:14.097551 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-ae28aa4a-e7b1-474a-a644-21c04c3659a1 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:14.531574 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-ae28aa4a-e7b1-474a-a644-21c04c3659a1 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81aa9d47cd1470abef31a27839eaf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8abe616c14a4920b1cbc45733fa5771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:39:14.539702 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-ae28aa4a-e7b1-474a-a644-21c04c3659a1 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] 10.222.0.57 "GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb" status: 200 len: 1520 microversion: 2.1 time: 0.456851 Jun 30 12:39:14.540267 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 349/687] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:39:14 2022] GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb => generated 1520 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:39:15.557483 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-117e6e65-a08a-4044-9042-c212890adc17 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:39:15.558100 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-117e6e65-a08a-4044-9042-c212890adc17 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] [instance: 17ef4273-4c60-498a-9061-2c4fbedbafdb] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:39:15.567290 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-117e6e65-a08a-4044-9042-c212890adc17 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:15.567748 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-117e6e65-a08a-4044-9042-c212890adc17 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:15.568574 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-117e6e65-a08a-4044-9042-c212890adc17 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:15.569040 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-117e6e65-a08a-4044-9042-c212890adc17 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:15.709998 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-117e6e65-a08a-4044-9042-c212890adc17 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81aa9d47cd1470abef31a27839eaf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8abe616c14a4920b1cbc45733fa5771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:39:15.719468 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-117e6e65-a08a-4044-9042-c212890adc17 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] 10.222.0.57 "GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb" status: 200 len: 1520 microversion: 2.1 time: 0.165916 Jun 30 12:39:15.720732 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 339/688] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:39:15 2022] GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:39:15.723006 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-79c91d4d-b6e8-4096-a9c3-c68aa19b3bf9 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:39:15.724092 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-79c91d4d-b6e8-4096-a9c3-c68aa19b3bf9 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 973c1877-9855-432d-819a-cdfcc917d844] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:39:15.735162 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-79c91d4d-b6e8-4096-a9c3-c68aa19b3bf9 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:15.735608 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-79c91d4d-b6e8-4096-a9c3-c68aa19b3bf9 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:15.737407 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-79c91d4d-b6e8-4096-a9c3-c68aa19b3bf9 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:15.737927 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-79c91d4d-b6e8-4096-a9c3-c68aa19b3bf9 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:15.771914 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-79c91d4d-b6e8-4096-a9c3-c68aa19b3bf9 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/973c1877-9855-432d-819a-cdfcc917d844/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053175 Jun 30 12:39:15.772506 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 350/689] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jun 30 12:39:15 2022] GET /compute/v2.1/servers/973c1877-9855-432d-819a-cdfcc917d844/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 12:39:15.785001 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-e95b22ce-c32a-4b2f-8d9c-5ddf568bfc85 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:39:15.785493 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-e95b22ce-c32a-4b2f-8d9c-5ddf568bfc85 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 973c1877-9855-432d-819a-cdfcc917d844] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:39:15.792021 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-e95b22ce-c32a-4b2f-8d9c-5ddf568bfc85 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:15.792468 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-e95b22ce-c32a-4b2f-8d9c-5ddf568bfc85 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:15.793238 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-e95b22ce-c32a-4b2f-8d9c-5ddf568bfc85 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:15.793670 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-e95b22ce-c32a-4b2f-8d9c-5ddf568bfc85 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:15.828335 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-e95b22ce-c32a-4b2f-8d9c-5ddf568bfc85 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/973c1877-9855-432d-819a-cdfcc917d844/os-volume_attachments/ae40f8d2-18c3-46b0-8da5-ff5f925b234e" status: 200 len: 194 microversion: 2.1 time: 0.048010 Jun 30 12:39:15.828966 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 340/690] 10.222.0.57 () {58 vars in 1412 bytes} [Thu Jun 30 12:39:15 2022] GET /compute/v2.1/servers/973c1877-9855-432d-819a-cdfcc917d844/os-volume_attachments/ae40f8d2-18c3-46b0-8da5-ff5f925b234e => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:39:16.736657 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-74efd5cb-1e26-4625-a039-1af2b1c10ec3 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:39:16.737235 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-74efd5cb-1e26-4625-a039-1af2b1c10ec3 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] [instance: 17ef4273-4c60-498a-9061-2c4fbedbafdb] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:39:16.744119 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-74efd5cb-1e26-4625-a039-1af2b1c10ec3 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:16.744570 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-74efd5cb-1e26-4625-a039-1af2b1c10ec3 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:16.745366 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-74efd5cb-1e26-4625-a039-1af2b1c10ec3 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:16.745819 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-74efd5cb-1e26-4625-a039-1af2b1c10ec3 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:16.878782 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-74efd5cb-1e26-4625-a039-1af2b1c10ec3 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81aa9d47cd1470abef31a27839eaf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8abe616c14a4920b1cbc45733fa5771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:39:16.886738 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-74efd5cb-1e26-4625-a039-1af2b1c10ec3 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] 10.222.0.57 "GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb" status: 200 len: 1576 microversion: 2.1 time: 0.154009 Jun 30 12:39:16.887317 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 351/691] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:39:16 2022] GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:39:17.161813 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-14aaa37a-49b8-4c20-abdb-552dcc349008 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1628e5a8-9c76-4019-9745-b0d4e3754d5e"}} {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:39:17.162956 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-14aaa37a-49b8-4c20-abdb-552dcc349008 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 973c1877-9855-432d-819a-cdfcc917d844] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:39:17.169985 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-14aaa37a-49b8-4c20-abdb-552dcc349008 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:17.170439 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-14aaa37a-49b8-4c20-abdb-552dcc349008 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:17.171193 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-14aaa37a-49b8-4c20-abdb-552dcc349008 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:17.171668 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-14aaa37a-49b8-4c20-abdb-552dcc349008 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:17.459795 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-14aaa37a-49b8-4c20-abdb-552dcc349008 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "POST /compute/v2.1/servers/973c1877-9855-432d-819a-cdfcc917d844/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.302155 Jun 30 12:39:17.460429 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 341/692] 10.222.0.57 () {60 vars in 1322 bytes} [Thu Jun 30 12:39:17 2022] POST /compute/v2.1/servers/973c1877-9855-432d-819a-cdfcc917d844/os-volume_attachments => generated 194 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:39:17.905693 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-5a83ce38-fdb8-41c6-9786-5a3b972af566 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:39:17.906239 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-5a83ce38-fdb8-41c6-9786-5a3b972af566 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] [instance: 17ef4273-4c60-498a-9061-2c4fbedbafdb] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:39:17.913448 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-5a83ce38-fdb8-41c6-9786-5a3b972af566 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:17.913939 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-5a83ce38-fdb8-41c6-9786-5a3b972af566 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:17.914706 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-5a83ce38-fdb8-41c6-9786-5a3b972af566 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:17.915136 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-5a83ce38-fdb8-41c6-9786-5a3b972af566 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:18.050962 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-5a83ce38-fdb8-41c6-9786-5a3b972af566 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81aa9d47cd1470abef31a27839eaf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8abe616c14a4920b1cbc45733fa5771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:39:18.062110 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-5a83ce38-fdb8-41c6-9786-5a3b972af566 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] 10.222.0.57 "GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb" status: 200 len: 1576 microversion: 2.1 time: 0.161124 Jun 30 12:39:18.062931 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 352/693] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:39:17 2022] GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:39:19.085039 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-dde3f1fb-e808-4459-919b-bc1782673b28 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:39:19.085821 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-dde3f1fb-e808-4459-919b-bc1782673b28 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] [instance: 17ef4273-4c60-498a-9061-2c4fbedbafdb] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:39:19.093211 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-dde3f1fb-e808-4459-919b-bc1782673b28 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:19.093711 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-dde3f1fb-e808-4459-919b-bc1782673b28 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:19.094572 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-dde3f1fb-e808-4459-919b-bc1782673b28 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:19.095061 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-dde3f1fb-e808-4459-919b-bc1782673b28 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:19.237012 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-dde3f1fb-e808-4459-919b-bc1782673b28 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81aa9d47cd1470abef31a27839eaf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8abe616c14a4920b1cbc45733fa5771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:39:19.248459 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-dde3f1fb-e808-4459-919b-bc1782673b28 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] 10.222.0.57 "GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb" status: 200 len: 1576 microversion: 2.1 time: 0.168875 Jun 30 12:39:19.249070 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 342/694] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:39:19 2022] GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb => generated 1576 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:39:20.268270 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-c44e08da-e3ba-400b-9b62-e53c469aa3bd tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:39:20.268948 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-c44e08da-e3ba-400b-9b62-e53c469aa3bd tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] [instance: 17ef4273-4c60-498a-9061-2c4fbedbafdb] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:39:20.276560 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-c44e08da-e3ba-400b-9b62-e53c469aa3bd tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:20.277057 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-c44e08da-e3ba-400b-9b62-e53c469aa3bd tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:20.277870 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-c44e08da-e3ba-400b-9b62-e53c469aa3bd tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:20.278329 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-c44e08da-e3ba-400b-9b62-e53c469aa3bd tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:20.417825 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-c44e08da-e3ba-400b-9b62-e53c469aa3bd tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81aa9d47cd1470abef31a27839eaf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8abe616c14a4920b1cbc45733fa5771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:39:20.426132 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-c44e08da-e3ba-400b-9b62-e53c469aa3bd tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] 10.222.0.57 "GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb" status: 200 len: 1576 microversion: 2.1 time: 0.162355 Jun 30 12:39:20.426708 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 353/695] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:39:20 2022] GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:39:21.447396 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-7ef66fa1-17ad-4355-b695-854ed6de59c5 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:39:21.448471 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-7ef66fa1-17ad-4355-b695-854ed6de59c5 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] [instance: 17ef4273-4c60-498a-9061-2c4fbedbafdb] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:39:21.459818 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-7ef66fa1-17ad-4355-b695-854ed6de59c5 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:21.460553 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-7ef66fa1-17ad-4355-b695-854ed6de59c5 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:21.462092 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-7ef66fa1-17ad-4355-b695-854ed6de59c5 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:21.462813 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-7ef66fa1-17ad-4355-b695-854ed6de59c5 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:21.606155 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-7ef66fa1-17ad-4355-b695-854ed6de59c5 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81aa9d47cd1470abef31a27839eaf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8abe616c14a4920b1cbc45733fa5771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:39:21.617534 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-7ef66fa1-17ad-4355-b695-854ed6de59c5 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] 10.222.0.57 "GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb" status: 200 len: 1576 microversion: 2.1 time: 0.176491 Jun 30 12:39:21.618338 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 343/696] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:39:21 2022] GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb => generated 1576 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:39:22.637169 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-6fabf3c6-cc7c-4d48-9c37-17e97b70dbb7 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:39:22.638097 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-6fabf3c6-cc7c-4d48-9c37-17e97b70dbb7 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] [instance: 17ef4273-4c60-498a-9061-2c4fbedbafdb] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:39:22.648394 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-6fabf3c6-cc7c-4d48-9c37-17e97b70dbb7 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:22.649055 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-6fabf3c6-cc7c-4d48-9c37-17e97b70dbb7 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:22.650089 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-6fabf3c6-cc7c-4d48-9c37-17e97b70dbb7 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:22.650704 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-6fabf3c6-cc7c-4d48-9c37-17e97b70dbb7 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:22.798388 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-6fabf3c6-cc7c-4d48-9c37-17e97b70dbb7 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81aa9d47cd1470abef31a27839eaf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8abe616c14a4920b1cbc45733fa5771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:39:22.806135 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-6fabf3c6-cc7c-4d48-9c37-17e97b70dbb7 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] 10.222.0.57 "GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb" status: 200 len: 1576 microversion: 2.1 time: 0.174605 Jun 30 12:39:22.806688 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 354/697] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:39:22 2022] GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb => generated 1576 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:39:23.823502 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-00ac8fb4-5aad-4a0b-ab18-d26d71bdc29a tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:39:23.824110 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-00ac8fb4-5aad-4a0b-ab18-d26d71bdc29a tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] [instance: 17ef4273-4c60-498a-9061-2c4fbedbafdb] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:39:23.831360 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-00ac8fb4-5aad-4a0b-ab18-d26d71bdc29a tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:23.831854 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-00ac8fb4-5aad-4a0b-ab18-d26d71bdc29a tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:23.832664 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-00ac8fb4-5aad-4a0b-ab18-d26d71bdc29a tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:23.833110 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-00ac8fb4-5aad-4a0b-ab18-d26d71bdc29a tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:23.967977 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-00ac8fb4-5aad-4a0b-ab18-d26d71bdc29a tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81aa9d47cd1470abef31a27839eaf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8abe616c14a4920b1cbc45733fa5771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:39:23.981290 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-00ac8fb4-5aad-4a0b-ab18-d26d71bdc29a tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] 10.222.0.57 "GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb" status: 200 len: 1576 microversion: 2.1 time: 0.161711 Jun 30 12:39:23.981946 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 344/698] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:39:23 2022] GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:39:24.990548 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-5874b8b3-413a-4d7c-ba64-856369c4f7f1 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:39:24.991497 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-5874b8b3-413a-4d7c-ba64-856369c4f7f1 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 973c1877-9855-432d-819a-cdfcc917d844] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:39:24.999163 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-5874b8b3-413a-4d7c-ba64-856369c4f7f1 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:24.999653 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-5874b8b3-413a-4d7c-ba64-856369c4f7f1 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:25.000426 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-5874b8b3-413a-4d7c-ba64-856369c4f7f1 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:25.000898 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-5874b8b3-413a-4d7c-ba64-856369c4f7f1 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:25.001226 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-6e6ff50f-1ef2-49d3-930d-65cd4bef9d7b tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:39:25.001836 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-6e6ff50f-1ef2-49d3-930d-65cd4bef9d7b tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] [instance: 17ef4273-4c60-498a-9061-2c4fbedbafdb] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:39:25.008513 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-6e6ff50f-1ef2-49d3-930d-65cd4bef9d7b tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:25.008980 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-6e6ff50f-1ef2-49d3-930d-65cd4bef9d7b tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:25.009937 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-6e6ff50f-1ef2-49d3-930d-65cd4bef9d7b tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:25.010366 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-6e6ff50f-1ef2-49d3-930d-65cd4bef9d7b tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:25.030956 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-5874b8b3-413a-4d7c-ba64-856369c4f7f1 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/973c1877-9855-432d-819a-cdfcc917d844/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044370 Jun 30 12:39:25.031525 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 355/699] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jun 30 12:39:24 2022] GET /compute/v2.1/servers/973c1877-9855-432d-819a-cdfcc917d844/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:39:25.147005 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-6e6ff50f-1ef2-49d3-930d-65cd4bef9d7b tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81aa9d47cd1470abef31a27839eaf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8abe616c14a4920b1cbc45733fa5771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:39:25.154849 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-6e6ff50f-1ef2-49d3-930d-65cd4bef9d7b tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] 10.222.0.57 "GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb" status: 200 len: 1576 microversion: 2.1 time: 0.159362 Jun 30 12:39:25.155572 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 345/700] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:39:24 2022] GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:39:25.176298 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-5e8651a9-debe-4cd9-849c-f6d587e8bdcb tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:39:25.176563 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-5e8651a9-debe-4cd9-849c-f6d587e8bdcb tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 973c1877-9855-432d-819a-cdfcc917d844] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:39:25.182963 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-5e8651a9-debe-4cd9-849c-f6d587e8bdcb tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:25.183408 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-5e8651a9-debe-4cd9-849c-f6d587e8bdcb tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:25.184226 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-5e8651a9-debe-4cd9-849c-f6d587e8bdcb tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:25.184650 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-5e8651a9-debe-4cd9-849c-f6d587e8bdcb tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:25.213171 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-5e8651a9-debe-4cd9-849c-f6d587e8bdcb tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/973c1877-9855-432d-819a-cdfcc917d844/os-volume_attachments/ae40f8d2-18c3-46b0-8da5-ff5f925b234e" status: 200 len: 194 microversion: 2.1 time: 0.041126 Jun 30 12:39:25.213758 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 356/701] 10.222.0.57 () {58 vars in 1412 bytes} [Thu Jun 30 12:39:25 2022] GET /compute/v2.1/servers/973c1877-9855-432d-819a-cdfcc917d844/os-volume_attachments/ae40f8d2-18c3-46b0-8da5-ff5f925b234e => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:39:25.224148 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-8bb6c0d7-2e71-4bd4-9b19-a8b59de224c9 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:39:25.224740 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-8bb6c0d7-2e71-4bd4-9b19-a8b59de224c9 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 973c1877-9855-432d-819a-cdfcc917d844] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:39:25.230829 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-8bb6c0d7-2e71-4bd4-9b19-a8b59de224c9 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:25.231274 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-8bb6c0d7-2e71-4bd4-9b19-a8b59de224c9 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:25.232041 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-8bb6c0d7-2e71-4bd4-9b19-a8b59de224c9 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:25.232481 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-8bb6c0d7-2e71-4bd4-9b19-a8b59de224c9 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:25.318879 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.objects.instance [None req-8bb6c0d7-2e71-4bd4-9b19-a8b59de224c9 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lazy-loading 'services' on Instance uuid 973c1877-9855-432d-819a-cdfcc917d844 {{(pid=124298) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 12:39:25.404088 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-8bb6c0d7-2e71-4bd4-9b19-a8b59de224c9 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "DELETE /compute/v2.1/servers/973c1877-9855-432d-819a-cdfcc917d844/os-volume_attachments/ae40f8d2-18c3-46b0-8da5-ff5f925b234e" status: 202 len: 0 microversion: 2.1 time: 0.184405 Jun 30 12:39:25.404712 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 346/702] 10.222.0.57 () {58 vars in 1415 bytes} [Thu Jun 30 12:39:25 2022] DELETE /compute/v2.1/servers/973c1877-9855-432d-819a-cdfcc917d844/os-volume_attachments/ae40f8d2-18c3-46b0-8da5-ff5f925b234e => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 12:39:26.177747 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-63f7f6ad-ca26-478c-b9ab-97669dc22874 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:39:26.178574 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-63f7f6ad-ca26-478c-b9ab-97669dc22874 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] [instance: 17ef4273-4c60-498a-9061-2c4fbedbafdb] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:39:26.190496 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-63f7f6ad-ca26-478c-b9ab-97669dc22874 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:26.191784 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-63f7f6ad-ca26-478c-b9ab-97669dc22874 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:26.192553 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-63f7f6ad-ca26-478c-b9ab-97669dc22874 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:26.193016 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-63f7f6ad-ca26-478c-b9ab-97669dc22874 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:26.197159 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG dbcounter [-] [124297] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:39:26.339604 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-63f7f6ad-ca26-478c-b9ab-97669dc22874 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81aa9d47cd1470abef31a27839eaf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8abe616c14a4920b1cbc45733fa5771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:39:26.347762 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-63f7f6ad-ca26-478c-b9ab-97669dc22874 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] 10.222.0.57 "GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb" status: 200 len: 1576 microversion: 2.1 time: 0.176798 Jun 30 12:39:26.348355 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 357/703] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:39:26 2022] GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb => generated 1576 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:39:26.740090 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [req-f637279f-33f7-4178-80ec-ee35d0f049b9 req-eb2c8371-276b-4ac9-b127-d739f9c3a214 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17ef4273-4c60-498a-9061-2c4fbedbafdb", "name": "network-vif-plugged", "status": "completed", "tag": "7fb1dbc5-fce3-4c9f-bb9e-b486d232eebc"}]} {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:39:26.750255 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [req-f637279f-33f7-4178-80ec-ee35d0f049b9 req-eb2c8371-276b-4ac9-b127-d739f9c3a214 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:26.750742 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [req-f637279f-33f7-4178-80ec-ee35d0f049b9 req-eb2c8371-276b-4ac9-b127-d739f9c3a214 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:26.765032 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.compute.server_external_events [req-f637279f-33f7-4178-80ec-ee35d0f049b9 req-eb2c8371-276b-4ac9-b127-d739f9c3a214 service nova] Creating event network-vif-plugged:7fb1dbc5-fce3-4c9f-bb9e-b486d232eebc for instance 17ef4273-4c60-498a-9061-2c4fbedbafdb on hv-cinder-84614 Jun 30 12:39:26.770411 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [req-f637279f-33f7-4178-80ec-ee35d0f049b9 req-eb2c8371-276b-4ac9-b127-d739f9c3a214 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035058 Jun 30 12:39:26.771179 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 347/704] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 30 12:39:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:39:27.373137 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-32a20c64-ba39-4aa6-9da3-31b38c7635cb tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:39:27.373724 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-32a20c64-ba39-4aa6-9da3-31b38c7635cb tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] [instance: 17ef4273-4c60-498a-9061-2c4fbedbafdb] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:39:27.383723 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-32a20c64-ba39-4aa6-9da3-31b38c7635cb tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:27.384282 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-32a20c64-ba39-4aa6-9da3-31b38c7635cb tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:27.385452 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-32a20c64-ba39-4aa6-9da3-31b38c7635cb tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:27.386029 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-32a20c64-ba39-4aa6-9da3-31b38c7635cb tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:27.530333 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-32a20c64-ba39-4aa6-9da3-31b38c7635cb tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81aa9d47cd1470abef31a27839eaf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8abe616c14a4920b1cbc45733fa5771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:39:27.538600 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-32a20c64-ba39-4aa6-9da3-31b38c7635cb tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] 10.222.0.57 "GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb" status: 200 len: 1576 microversion: 2.1 time: 0.172042 Jun 30 12:39:27.539173 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 358/705] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:39:27 2022] GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb => generated 1576 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:39:27.577436 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-8eafdae5-585f-4721-8eab-fe9a3812b291 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:39:27.578007 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-8eafdae5-585f-4721-8eab-fe9a3812b291 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 973c1877-9855-432d-819a-cdfcc917d844] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:39:27.585020 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-8eafdae5-585f-4721-8eab-fe9a3812b291 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:27.585489 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-8eafdae5-585f-4721-8eab-fe9a3812b291 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:27.586210 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-8eafdae5-585f-4721-8eab-fe9a3812b291 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:27.586631 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-8eafdae5-585f-4721-8eab-fe9a3812b291 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:27.616114 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-8eafdae5-585f-4721-8eab-fe9a3812b291 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/973c1877-9855-432d-819a-cdfcc917d844/os-volume_attachments/1628e5a8-9c76-4019-9745-b0d4e3754d5e" status: 200 len: 194 microversion: 2.1 time: 0.043018 Jun 30 12:39:27.616732 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 348/706] 10.222.0.57 () {58 vars in 1412 bytes} [Thu Jun 30 12:39:27 2022] GET /compute/v2.1/servers/973c1877-9855-432d-819a-cdfcc917d844/os-volume_attachments/1628e5a8-9c76-4019-9745-b0d4e3754d5e => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:39:27.627051 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-3a3454ba-e4f6-4a72-af60-519077fabb32 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:39:27.627479 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-3a3454ba-e4f6-4a72-af60-519077fabb32 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 973c1877-9855-432d-819a-cdfcc917d844] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:39:27.633941 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-3a3454ba-e4f6-4a72-af60-519077fabb32 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:27.634495 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-3a3454ba-e4f6-4a72-af60-519077fabb32 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:27.635231 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-3a3454ba-e4f6-4a72-af60-519077fabb32 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:27.635704 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-3a3454ba-e4f6-4a72-af60-519077fabb32 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:27.740703 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.objects.instance [None req-3a3454ba-e4f6-4a72-af60-519077fabb32 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lazy-loading 'services' on Instance uuid 973c1877-9855-432d-819a-cdfcc917d844 {{(pid=124297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 12:39:27.822854 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-3a3454ba-e4f6-4a72-af60-519077fabb32 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "DELETE /compute/v2.1/servers/973c1877-9855-432d-819a-cdfcc917d844/os-volume_attachments/1628e5a8-9c76-4019-9745-b0d4e3754d5e" status: 202 len: 0 microversion: 2.1 time: 0.199821 Jun 30 12:39:27.823443 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 359/707] 10.222.0.57 () {58 vars in 1415 bytes} [Thu Jun 30 12:39:27 2022] DELETE /compute/v2.1/servers/973c1877-9855-432d-819a-cdfcc917d844/os-volume_attachments/1628e5a8-9c76-4019-9745-b0d4e3754d5e => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 12:39:28.555578 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-01e8082f-2870-47ea-ada8-69b82fd139e2 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:39:28.556149 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-01e8082f-2870-47ea-ada8-69b82fd139e2 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] [instance: 17ef4273-4c60-498a-9061-2c4fbedbafdb] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:39:28.563298 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-01e8082f-2870-47ea-ada8-69b82fd139e2 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:28.563740 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-01e8082f-2870-47ea-ada8-69b82fd139e2 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:28.564491 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-01e8082f-2870-47ea-ada8-69b82fd139e2 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:28.564954 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-01e8082f-2870-47ea-ada8-69b82fd139e2 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:28.709421 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-01e8082f-2870-47ea-ada8-69b82fd139e2 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81aa9d47cd1470abef31a27839eaf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8abe616c14a4920b1cbc45733fa5771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:39:28.722143 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-01e8082f-2870-47ea-ada8-69b82fd139e2 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] 10.222.0.57 "GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb" status: 200 len: 1563 microversion: 2.1 time: 0.170298 Jun 30 12:39:28.722722 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 349/708] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:39:28 2022] GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb => generated 1563 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:39:30.083634 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-497eb3a4-a6ed-455a-a24d-ea08767ef97a tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:39:30.084705 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-497eb3a4-a6ed-455a-a24d-ea08767ef97a tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 973c1877-9855-432d-819a-cdfcc917d844] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:39:30.091656 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-497eb3a4-a6ed-455a-a24d-ea08767ef97a tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:30.092106 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-497eb3a4-a6ed-455a-a24d-ea08767ef97a tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:30.092908 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-497eb3a4-a6ed-455a-a24d-ea08767ef97a tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:30.093341 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-497eb3a4-a6ed-455a-a24d-ea08767ef97a tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:30.122413 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-497eb3a4-a6ed-455a-a24d-ea08767ef97a tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/973c1877-9855-432d-819a-cdfcc917d844/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043149 Jun 30 12:39:30.122972 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 360/709] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jun 30 12:39:30 2022] GET /compute/v2.1/servers/973c1877-9855-432d-819a-cdfcc917d844/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 30 12:39:30.232732 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-c545148f-d9a6-4aa9-ba13-050f275f3e1b tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:39:30.233727 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-c545148f-d9a6-4aa9-ba13-050f275f3e1b tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 973c1877-9855-432d-819a-cdfcc917d844] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:39:30.241545 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-c545148f-d9a6-4aa9-ba13-050f275f3e1b tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:30.241996 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-c545148f-d9a6-4aa9-ba13-050f275f3e1b tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:30.242777 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-c545148f-d9a6-4aa9-ba13-050f275f3e1b tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:30.243207 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-c545148f-d9a6-4aa9-ba13-050f275f3e1b tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:30.272461 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-c545148f-d9a6-4aa9-ba13-050f275f3e1b tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/973c1877-9855-432d-819a-cdfcc917d844/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043745 Jun 30 12:39:30.273050 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 350/710] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jun 30 12:39:30 2022] GET /compute/v2.1/servers/973c1877-9855-432d-819a-cdfcc917d844/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 30 12:39:30.331140 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-6dd2caeb-a100-4453-80c1-ea525e039dd6 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:39:30.331628 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-6dd2caeb-a100-4453-80c1-ea525e039dd6 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 973c1877-9855-432d-819a-cdfcc917d844] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:39:30.337857 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-6dd2caeb-a100-4453-80c1-ea525e039dd6 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:30.338299 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-6dd2caeb-a100-4453-80c1-ea525e039dd6 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:30.339054 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-6dd2caeb-a100-4453-80c1-ea525e039dd6 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:30.339486 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-6dd2caeb-a100-4453-80c1-ea525e039dd6 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:30.365317 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-6dd2caeb-a100-4453-80c1-ea525e039dd6 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 973c1877-9855-432d-819a-cdfcc917d844] Going to try to terminate instance {{(pid=124297) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 12:39:30.457272 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-6dd2caeb-a100-4453-80c1-ea525e039dd6 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "DELETE /compute/v2.1/servers/973c1877-9855-432d-819a-cdfcc917d844" status: 204 len: 0 microversion: 2.1 time: 0.129737 Jun 30 12:39:30.458069 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 361/711] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 30 12:39:30 2022] DELETE /compute/v2.1/servers/973c1877-9855-432d-819a-cdfcc917d844 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 12:39:30.466637 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-7b88cddb-05e2-4eed-aba0-d2fd013722bd tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:39:30.467315 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-7b88cddb-05e2-4eed-aba0-d2fd013722bd tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 973c1877-9855-432d-819a-cdfcc917d844] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:39:30.473435 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-7b88cddb-05e2-4eed-aba0-d2fd013722bd tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:30.473884 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-7b88cddb-05e2-4eed-aba0-d2fd013722bd tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:30.474648 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-7b88cddb-05e2-4eed-aba0-d2fd013722bd tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:30.475080 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-7b88cddb-05e2-4eed-aba0-d2fd013722bd tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:30.493312 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG dbcounter [-] [124298] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:39:30.608301 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-7b88cddb-05e2-4eed-aba0-d2fd013722bd tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddb38b4d6864a6c96b84c9a4092eea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60d10dba1d947cc97149a063a810129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:39:30.616605 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-7b88cddb-05e2-4eed-aba0-d2fd013722bd tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/973c1877-9855-432d-819a-cdfcc917d844" status: 200 len: 1672 microversion: 2.1 time: 0.153953 Jun 30 12:39:30.617225 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 351/712] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:39:30 2022] GET /compute/v2.1/servers/973c1877-9855-432d-819a-cdfcc917d844 => generated 1672 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:39:31.638709 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-5ff1304e-4911-4298-ba5a-432753b6067f tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:39:31.639891 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-5ff1304e-4911-4298-ba5a-432753b6067f tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 973c1877-9855-432d-819a-cdfcc917d844] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:39:31.650916 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-5ff1304e-4911-4298-ba5a-432753b6067f tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:31.651664 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-5ff1304e-4911-4298-ba5a-432753b6067f tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:31.653002 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-5ff1304e-4911-4298-ba5a-432753b6067f tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:31.653731 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-5ff1304e-4911-4298-ba5a-432753b6067f tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:31.800156 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-5ff1304e-4911-4298-ba5a-432753b6067f tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddb38b4d6864a6c96b84c9a4092eea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60d10dba1d947cc97149a063a810129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:39:31.809389 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-5ff1304e-4911-4298-ba5a-432753b6067f tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/973c1877-9855-432d-819a-cdfcc917d844" status: 200 len: 1672 microversion: 2.1 time: 0.177838 Jun 30 12:39:31.809960 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 362/713] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:39:31 2022] GET /compute/v2.1/servers/973c1877-9855-432d-819a-cdfcc917d844 => generated 1672 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:39:32.831164 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-1b58022c-d750-44a5-983b-dc4b7686cc26 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:39:32.832110 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-1b58022c-d750-44a5-983b-dc4b7686cc26 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 973c1877-9855-432d-819a-cdfcc917d844] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:39:32.839563 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-1b58022c-d750-44a5-983b-dc4b7686cc26 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:32.840015 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-1b58022c-d750-44a5-983b-dc4b7686cc26 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:32.840822 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-1b58022c-d750-44a5-983b-dc4b7686cc26 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:32.841264 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-1b58022c-d750-44a5-983b-dc4b7686cc26 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:33.018557 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-1b58022c-d750-44a5-983b-dc4b7686cc26 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddb38b4d6864a6c96b84c9a4092eea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60d10dba1d947cc97149a063a810129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:39:33.027797 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-1b58022c-d750-44a5-983b-dc4b7686cc26 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/973c1877-9855-432d-819a-cdfcc917d844" status: 200 len: 1672 microversion: 2.1 time: 0.203173 Jun 30 12:39:33.028614 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 352/714] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:39:32 2022] GET /compute/v2.1/servers/973c1877-9855-432d-819a-cdfcc917d844 => generated 1672 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:39:33.853691 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [req-31e05854-50b3-4804-a385-3f3f1bd8be2b req-05ca6d61-43c9-453d-97e5-e0da12c4289b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "973c1877-9855-432d-819a-cdfcc917d844", "name": "network-vif-deleted", "tag": "aaa72124-a7b1-4c09-844d-d0fffd8ed459"}]} {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:39:33.862873 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [req-31e05854-50b3-4804-a385-3f3f1bd8be2b req-05ca6d61-43c9-453d-97e5-e0da12c4289b service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:33.863314 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [req-31e05854-50b3-4804-a385-3f3f1bd8be2b req-05ca6d61-43c9-453d-97e5-e0da12c4289b service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:33.875030 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.compute.server_external_events [req-31e05854-50b3-4804-a385-3f3f1bd8be2b req-05ca6d61-43c9-453d-97e5-e0da12c4289b service nova] Creating event network-vif-deleted:aaa72124-a7b1-4c09-844d-d0fffd8ed459 for instance 973c1877-9855-432d-819a-cdfcc917d844 on hv-cinder-84614 Jun 30 12:39:33.879918 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [req-31e05854-50b3-4804-a385-3f3f1bd8be2b req-05ca6d61-43c9-453d-97e5-e0da12c4289b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029712 Jun 30 12:39:33.880993 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 363/715] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 30 12:39:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:39:34.049743 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-ab70e174-2dfc-4700-95eb-74a331fb9750 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:39:34.050761 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-ab70e174-2dfc-4700-95eb-74a331fb9750 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 973c1877-9855-432d-819a-cdfcc917d844] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:39:34.060091 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-ab70e174-2dfc-4700-95eb-74a331fb9750 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:34.060665 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-ab70e174-2dfc-4700-95eb-74a331fb9750 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:34.061694 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-ab70e174-2dfc-4700-95eb-74a331fb9750 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:34.062224 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-ab70e174-2dfc-4700-95eb-74a331fb9750 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:34.095577 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-ab70e174-2dfc-4700-95eb-74a331fb9750 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:34.096021 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-ab70e174-2dfc-4700-95eb-74a331fb9750 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:34.096468 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.objects.instance [None req-ab70e174-2dfc-4700-95eb-74a331fb9750 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lazy-loading 'fault' on Instance uuid 973c1877-9855-432d-819a-cdfcc917d844 {{(pid=124298) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 12:39:34.140616 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-ab70e174-2dfc-4700-95eb-74a331fb9750 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddb38b4d6864a6c96b84c9a4092eea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60d10dba1d947cc97149a063a810129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:39:34.148369 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-ab70e174-2dfc-4700-95eb-74a331fb9750 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/973c1877-9855-432d-819a-cdfcc917d844" status: 200 len: 1326 microversion: 2.1 time: 0.105405 Jun 30 12:39:34.148981 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 353/716] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:39:34 2022] GET /compute/v2.1/servers/973c1877-9855-432d-819a-cdfcc917d844 => generated 1326 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:39:35.171898 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-fef8eb22-be0d-4e26-a2ba-5d0aa71d2374 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:39:35.172906 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-fef8eb22-be0d-4e26-a2ba-5d0aa71d2374 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 973c1877-9855-432d-819a-cdfcc917d844] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:39:35.184340 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-fef8eb22-be0d-4e26-a2ba-5d0aa71d2374 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:35.185130 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-fef8eb22-be0d-4e26-a2ba-5d0aa71d2374 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:35.186432 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-fef8eb22-be0d-4e26-a2ba-5d0aa71d2374 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:35.187148 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-fef8eb22-be0d-4e26-a2ba-5d0aa71d2374 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:35.202745 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.wsgi [None req-fef8eb22-be0d-4e26-a2ba-5d0aa71d2374 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] HTTP exception thrown: Instance 973c1877-9855-432d-819a-cdfcc917d844 could not be found. Jun 30 12:39:35.204353 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-fef8eb22-be0d-4e26-a2ba-5d0aa71d2374 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Request method failure captured: Jun 30 12:39:35.204353 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: request: GET /compute/v2.1/servers/973c1877-9855-432d-819a-cdfcc917d844 HTTP/1.1 Jun 30 12:39:35.204353 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Accept: application/json Jun 30 12:39:35.204353 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Accept-Encoding: identity Jun 30 12:39:35.204353 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Connection: close Jun 30 12:39:35.204353 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Content-Length: 0 Jun 30 12:39:35.204353 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Content-Type: application/json Jun 30 12:39:35.204353 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Host: 10.222.0.57 Jun 30 12:39:35.204353 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Openstack-System-Scope: None Jun 30 12:39:35.204353 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: User-Agent: python-urllib3/1.26.9 Jun 30 12:39:35.204353 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Auth-Token: gAAAAABivZf4l2uN2l7MZf1ZhxzVFfts0wg0_KMAarn_6hpljXzQrjCE_nI8N7K9WLga4GIDF0IaS7huxljiZYYC8_sdgJ99DASpal2KKCfcwxDzeH2kiKHCakZvOuVM8Hd3lglaApvXhJAuoMzyvjLzbCFt5-vglJcWrsab-0Ua-0r9pZ9hVWM Jun 30 12:39:35.204353 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Domain-Id: None Jun 30 12:39:35.204353 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Domain-Name: None Jun 30 12:39:35.204353 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Identity-Status: Confirmed Jun 30 12:39:35.204353 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Is-Admin-Project: True Jun 30 12:39:35.204353 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Project-Domain-Id: default Jun 30 12:39:35.204353 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Project-Domain-Name: Default Jun 30 12:39:35.204353 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Project-Id: b60d10dba1d947cc97149a063a810129 Jun 30 12:39:35.204353 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Project-Name: tempest-AttachVolumeTestJSON-868731092 Jun 30 12:39:35.204353 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Role: member,reader Jun 30 12:39:35.204353 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Roles: member,reader Jun 30 12:39:35.205973 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/b60d10dba1d947cc97149a063a810129"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b60d10dba1d947cc97149a063a810129"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_b60d10dba1d947cc97149a063a810129", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b60d10dba1d947cc97149a063a810129"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 30 12:39:35.205973 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Tenant: tempest-AttachVolumeTestJSON-868731092 Jun 30 12:39:35.205973 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Tenant-Id: b60d10dba1d947cc97149a063a810129 Jun 30 12:39:35.205973 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Tenant-Name: tempest-AttachVolumeTestJSON-868731092 Jun 30 12:39:35.205973 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User: tempest-AttachVolumeTestJSON-868731092-project Jun 30 12:39:35.205973 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User-Domain-Id: default Jun 30 12:39:35.205973 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User-Domain-Name: Default Jun 30 12:39:35.205973 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User-Id: 6ddb38b4d6864a6c96b84c9a4092eea8 Jun 30 12:39:35.205973 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User-Name: tempest-AttachVolumeTestJSON-868731092-project Jun 30 12:39:35.205973 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: method: > Jun 30 12:39:35.205973 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: exception: Instance 973c1877-9855-432d-819a-cdfcc917d844 could not be found. Jun 30 12:39:35.205973 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: action_args: {'id': '973c1877-9855-432d-819a-cdfcc917d844'} Jun 30 12:39:35.206881 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 12:39:35.206881 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:39:35.206881 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 12:39:35.206881 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 12:39:35.206881 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 12:39:35.206881 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 12:39:35.206881 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 12:39:35.206881 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 12:39:35.206881 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 12:39:35.206881 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 12:39:35.206881 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 973c1877-9855-432d-819a-cdfcc917d844 could not be found. Jun 30 12:39:35.206881 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:39:35.206881 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:39:35.206881 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:39:35.206881 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:39:35.206881 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:39:35.206881 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:39:35.206881 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 12:39:35.206881 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 12:39:35.206881 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 12:39:35.208547 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 12:39:35.208547 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 12:39:35.208547 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 12:39:35.208547 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 12:39:35.208547 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 12:39:35.208547 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 12:39:35.208547 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 12:39:35.208547 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 973c1877-9855-432d-819a-cdfcc917d844 could not be found. Jun 30 12:39:35.208547 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:39:35.208547 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:39:35.208547 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:39:35.208547 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:39:35.208547 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:39:35.208547 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:39:35.208547 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 12:39:35.208547 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 12:39:35.208547 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 973c1877-9855-432d-819a-cdfcc917d844 could not be found. Jun 30 12:39:35.208547 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:39:35.209966 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-fef8eb22-be0d-4e26-a2ba-5d0aa71d2374 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Returning 404 to user: Instance 973c1877-9855-432d-819a-cdfcc917d844 could not be found. {{(pid=124297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 12:39:35.209966 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-fef8eb22-be0d-4e26-a2ba-5d0aa71d2374 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/973c1877-9855-432d-819a-cdfcc917d844" status: 404 len: 111 microversion: 2.1 time: 0.042098 Jun 30 12:39:35.209966 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 364/717] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:39:35 2022] GET /compute/v2.1/servers/973c1877-9855-432d-819a-cdfcc917d844 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 12:39:35.215119 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-b8c7556c-57c0-4dfe-8aca-54070cf21ea8 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '.version_select at 0x7fd0e0130820>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:39:35.235122 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-b8c7556c-57c0-4dfe-8aca-54070cf21ea8 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-102205801" status: 202 len: 0 microversion: 2.1 time: 0.023832 Jun 30 12:39:35.235686 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 354/718] 10.222.0.57 () {58 vars in 1217 bytes} [Thu Jun 30 12:39:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-102205801 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 12:39:38.148349 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-37cd691a-eed1-48b7-b4ff-e19204c87469 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:39:38.148939 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-37cd691a-eed1-48b7-b4ff-e19204c87469 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 973c1877-9855-432d-819a-cdfcc917d844] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:39:38.151355 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG dbcounter [-] [124297] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=124297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:39:38.157456 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-37cd691a-eed1-48b7-b4ff-e19204c87469 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:38.157936 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-37cd691a-eed1-48b7-b4ff-e19204c87469 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:38.158711 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-37cd691a-eed1-48b7-b4ff-e19204c87469 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:38.159143 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-37cd691a-eed1-48b7-b4ff-e19204c87469 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:38.174666 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.wsgi [None req-37cd691a-eed1-48b7-b4ff-e19204c87469 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] HTTP exception thrown: Instance 973c1877-9855-432d-819a-cdfcc917d844 could not be found. Jun 30 12:39:38.176276 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-37cd691a-eed1-48b7-b4ff-e19204c87469 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Request method failure captured: Jun 30 12:39:38.176276 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: request: DELETE /compute/v2.1/servers/973c1877-9855-432d-819a-cdfcc917d844 HTTP/1.1 Jun 30 12:39:38.176276 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Accept: application/json Jun 30 12:39:38.176276 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Accept-Encoding: identity Jun 30 12:39:38.176276 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Connection: close Jun 30 12:39:38.176276 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Content-Length: 0 Jun 30 12:39:38.176276 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Content-Type: application/json Jun 30 12:39:38.176276 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Host: 10.222.0.57 Jun 30 12:39:38.176276 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Openstack-System-Scope: None Jun 30 12:39:38.176276 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: User-Agent: python-urllib3/1.26.9 Jun 30 12:39:38.176276 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Auth-Token: gAAAAABivZf4l2uN2l7MZf1ZhxzVFfts0wg0_KMAarn_6hpljXzQrjCE_nI8N7K9WLga4GIDF0IaS7huxljiZYYC8_sdgJ99DASpal2KKCfcwxDzeH2kiKHCakZvOuVM8Hd3lglaApvXhJAuoMzyvjLzbCFt5-vglJcWrsab-0Ua-0r9pZ9hVWM Jun 30 12:39:38.176276 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Domain-Id: None Jun 30 12:39:38.176276 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Domain-Name: None Jun 30 12:39:38.176276 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Identity-Status: Confirmed Jun 30 12:39:38.176276 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Is-Admin-Project: True Jun 30 12:39:38.176276 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Project-Domain-Id: default Jun 30 12:39:38.176276 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Project-Domain-Name: Default Jun 30 12:39:38.176276 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Project-Id: b60d10dba1d947cc97149a063a810129 Jun 30 12:39:38.176276 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Project-Name: tempest-AttachVolumeTestJSON-868731092 Jun 30 12:39:38.176276 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Role: member,reader Jun 30 12:39:38.176276 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Roles: member,reader Jun 30 12:39:38.177893 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/b60d10dba1d947cc97149a063a810129"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b60d10dba1d947cc97149a063a810129"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_b60d10dba1d947cc97149a063a810129", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b60d10dba1d947cc97149a063a810129"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 30 12:39:38.177893 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Tenant: tempest-AttachVolumeTestJSON-868731092 Jun 30 12:39:38.177893 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Tenant-Id: b60d10dba1d947cc97149a063a810129 Jun 30 12:39:38.177893 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Tenant-Name: tempest-AttachVolumeTestJSON-868731092 Jun 30 12:39:38.177893 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User: tempest-AttachVolumeTestJSON-868731092-project Jun 30 12:39:38.177893 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User-Domain-Id: default Jun 30 12:39:38.177893 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User-Domain-Name: Default Jun 30 12:39:38.177893 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User-Id: 6ddb38b4d6864a6c96b84c9a4092eea8 Jun 30 12:39:38.177893 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User-Name: tempest-AttachVolumeTestJSON-868731092-project Jun 30 12:39:38.177893 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: method: > Jun 30 12:39:38.177893 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: exception: Instance 973c1877-9855-432d-819a-cdfcc917d844 could not be found. Jun 30 12:39:38.177893 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: action_args: {'id': '973c1877-9855-432d-819a-cdfcc917d844'} Jun 30 12:39:38.178885 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 12:39:38.178885 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:39:38.178885 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 12:39:38.178885 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 12:39:38.178885 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 12:39:38.178885 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 12:39:38.178885 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 12:39:38.178885 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 12:39:38.178885 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 12:39:38.178885 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 12:39:38.178885 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 973c1877-9855-432d-819a-cdfcc917d844 could not be found. Jun 30 12:39:38.178885 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:39:38.178885 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:39:38.178885 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:39:38.178885 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:39:38.178885 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:39:38.178885 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:39:38.178885 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 12:39:38.178885 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 12:39:38.178885 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 12:39:38.180263 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 12:39:38.180263 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 30 12:39:38.180263 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 30 12:39:38.180263 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 30 12:39:38.180263 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 30 12:39:38.180263 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 12:39:38.180263 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 12:39:38.180263 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 12:39:38.180263 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 12:39:38.180263 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 973c1877-9855-432d-819a-cdfcc917d844 could not be found. Jun 30 12:39:38.180263 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:39:38.180263 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:39:38.180263 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:39:38.180263 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:39:38.180263 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:39:38.180263 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:39:38.180263 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 12:39:38.180263 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 12:39:38.180263 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 973c1877-9855-432d-819a-cdfcc917d844 could not be found. Jun 30 12:39:38.180263 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:39:38.181626 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-37cd691a-eed1-48b7-b4ff-e19204c87469 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Returning 404 to user: Instance 973c1877-9855-432d-819a-cdfcc917d844 could not be found. {{(pid=124297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 12:39:38.181626 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-37cd691a-eed1-48b7-b4ff-e19204c87469 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "DELETE /compute/v2.1/servers/973c1877-9855-432d-819a-cdfcc917d844" status: 404 len: 111 microversion: 2.1 time: 0.033456 Jun 30 12:39:38.181626 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 365/719] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 30 12:39:38 2022] DELETE /compute/v2.1/servers/973c1877-9855-432d-819a-cdfcc917d844 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 12:39:38.187167 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-c6609439-0ae0-45f8-b2f1-a9f6d3989f76 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:39:38.187792 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-c6609439-0ae0-45f8-b2f1-a9f6d3989f76 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 973c1877-9855-432d-819a-cdfcc917d844] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:39:38.194191 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-c6609439-0ae0-45f8-b2f1-a9f6d3989f76 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:38.194643 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-c6609439-0ae0-45f8-b2f1-a9f6d3989f76 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:38.195423 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-c6609439-0ae0-45f8-b2f1-a9f6d3989f76 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:38.195853 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-c6609439-0ae0-45f8-b2f1-a9f6d3989f76 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:38.209580 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.wsgi [None req-c6609439-0ae0-45f8-b2f1-a9f6d3989f76 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] HTTP exception thrown: Instance 973c1877-9855-432d-819a-cdfcc917d844 could not be found. Jun 30 12:39:38.211250 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-c6609439-0ae0-45f8-b2f1-a9f6d3989f76 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Request method failure captured: Jun 30 12:39:38.211250 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: request: GET /compute/v2.1/servers/973c1877-9855-432d-819a-cdfcc917d844 HTTP/1.1 Jun 30 12:39:38.211250 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Accept: application/json Jun 30 12:39:38.211250 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Accept-Encoding: identity Jun 30 12:39:38.211250 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Connection: close Jun 30 12:39:38.211250 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Content-Length: 0 Jun 30 12:39:38.211250 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Content-Type: application/json Jun 30 12:39:38.211250 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Host: 10.222.0.57 Jun 30 12:39:38.211250 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Openstack-System-Scope: None Jun 30 12:39:38.211250 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: User-Agent: python-urllib3/1.26.9 Jun 30 12:39:38.211250 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Auth-Token: gAAAAABivZf4l2uN2l7MZf1ZhxzVFfts0wg0_KMAarn_6hpljXzQrjCE_nI8N7K9WLga4GIDF0IaS7huxljiZYYC8_sdgJ99DASpal2KKCfcwxDzeH2kiKHCakZvOuVM8Hd3lglaApvXhJAuoMzyvjLzbCFt5-vglJcWrsab-0Ua-0r9pZ9hVWM Jun 30 12:39:38.211250 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Domain-Id: None Jun 30 12:39:38.211250 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Domain-Name: None Jun 30 12:39:38.211250 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Identity-Status: Confirmed Jun 30 12:39:38.211250 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Is-Admin-Project: True Jun 30 12:39:38.211250 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Domain-Id: default Jun 30 12:39:38.211250 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Domain-Name: Default Jun 30 12:39:38.211250 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Id: b60d10dba1d947cc97149a063a810129 Jun 30 12:39:38.211250 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Name: tempest-AttachVolumeTestJSON-868731092 Jun 30 12:39:38.211250 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Role: member,reader Jun 30 12:39:38.211250 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Roles: member,reader Jun 30 12:39:38.212823 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/b60d10dba1d947cc97149a063a810129"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b60d10dba1d947cc97149a063a810129"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_b60d10dba1d947cc97149a063a810129", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b60d10dba1d947cc97149a063a810129"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 30 12:39:38.212823 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant: tempest-AttachVolumeTestJSON-868731092 Jun 30 12:39:38.212823 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant-Id: b60d10dba1d947cc97149a063a810129 Jun 30 12:39:38.212823 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant-Name: tempest-AttachVolumeTestJSON-868731092 Jun 30 12:39:38.212823 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User: tempest-AttachVolumeTestJSON-868731092-project Jun 30 12:39:38.212823 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Domain-Id: default Jun 30 12:39:38.212823 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Domain-Name: Default Jun 30 12:39:38.212823 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Id: 6ddb38b4d6864a6c96b84c9a4092eea8 Jun 30 12:39:38.212823 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Name: tempest-AttachVolumeTestJSON-868731092-project Jun 30 12:39:38.212823 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: method: > Jun 30 12:39:38.212823 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: exception: Instance 973c1877-9855-432d-819a-cdfcc917d844 could not be found. Jun 30 12:39:38.212823 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: action_args: {'id': '973c1877-9855-432d-819a-cdfcc917d844'} Jun 30 12:39:38.213709 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 12:39:38.213709 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:39:38.213709 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 12:39:38.213709 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 12:39:38.213709 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 12:39:38.213709 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 12:39:38.213709 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 12:39:38.213709 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 12:39:38.213709 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 12:39:38.213709 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 12:39:38.213709 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 973c1877-9855-432d-819a-cdfcc917d844 could not be found. Jun 30 12:39:38.213709 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:39:38.213709 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:39:38.213709 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:39:38.213709 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:39:38.213709 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:39:38.213709 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:39:38.213709 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 12:39:38.213709 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 12:39:38.213709 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 12:39:38.215230 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 12:39:38.215230 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 12:39:38.215230 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 12:39:38.215230 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 12:39:38.215230 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 12:39:38.215230 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 12:39:38.215230 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 12:39:38.215230 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 973c1877-9855-432d-819a-cdfcc917d844 could not be found. Jun 30 12:39:38.215230 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:39:38.215230 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:39:38.215230 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:39:38.215230 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:39:38.215230 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:39:38.215230 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:39:38.215230 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 12:39:38.215230 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 12:39:38.215230 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 973c1877-9855-432d-819a-cdfcc917d844 could not be found. Jun 30 12:39:38.215230 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:39:38.216658 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-c6609439-0ae0-45f8-b2f1-a9f6d3989f76 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Returning 404 to user: Instance 973c1877-9855-432d-819a-cdfcc917d844 could not be found. {{(pid=124298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 12:39:38.216658 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-c6609439-0ae0-45f8-b2f1-a9f6d3989f76 tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/973c1877-9855-432d-819a-cdfcc917d844" status: 404 len: 111 microversion: 2.1 time: 0.030118 Jun 30 12:39:38.216658 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 355/720] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:39:38 2022] GET /compute/v2.1/servers/973c1877-9855-432d-819a-cdfcc917d844 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 12:39:39.357594 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-f1474c1c-4d58-4f35-ab4f-9b747c39092a tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:39:39.358140 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-f1474c1c-4d58-4f35-ab4f-9b747c39092a tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 99ba3b96-6700-41e0-b2cf-ff8933b2bf94] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:39:39.365427 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-f1474c1c-4d58-4f35-ab4f-9b747c39092a tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:39.365882 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-f1474c1c-4d58-4f35-ab4f-9b747c39092a tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:39.366653 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-f1474c1c-4d58-4f35-ab4f-9b747c39092a tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:39.367069 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-f1474c1c-4d58-4f35-ab4f-9b747c39092a tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:39.381063 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.wsgi [None req-f1474c1c-4d58-4f35-ab4f-9b747c39092a tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] HTTP exception thrown: Instance 99ba3b96-6700-41e0-b2cf-ff8933b2bf94 could not be found. Jun 30 12:39:39.382614 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-f1474c1c-4d58-4f35-ab4f-9b747c39092a tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Request method failure captured: Jun 30 12:39:39.382614 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: request: DELETE /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94 HTTP/1.1 Jun 30 12:39:39.382614 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Accept: application/json Jun 30 12:39:39.382614 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Accept-Encoding: identity Jun 30 12:39:39.382614 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Connection: close Jun 30 12:39:39.382614 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Content-Length: 0 Jun 30 12:39:39.382614 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Content-Type: application/json Jun 30 12:39:39.382614 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Host: 10.222.0.57 Jun 30 12:39:39.382614 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Openstack-System-Scope: None Jun 30 12:39:39.382614 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: User-Agent: python-urllib3/1.26.9 Jun 30 12:39:39.382614 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Auth-Token: gAAAAABivZf4l2uN2l7MZf1ZhxzVFfts0wg0_KMAarn_6hpljXzQrjCE_nI8N7K9WLga4GIDF0IaS7huxljiZYYC8_sdgJ99DASpal2KKCfcwxDzeH2kiKHCakZvOuVM8Hd3lglaApvXhJAuoMzyvjLzbCFt5-vglJcWrsab-0Ua-0r9pZ9hVWM Jun 30 12:39:39.382614 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Domain-Id: None Jun 30 12:39:39.382614 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Domain-Name: None Jun 30 12:39:39.382614 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Identity-Status: Confirmed Jun 30 12:39:39.382614 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Is-Admin-Project: True Jun 30 12:39:39.382614 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Project-Domain-Id: default Jun 30 12:39:39.382614 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Project-Domain-Name: Default Jun 30 12:39:39.382614 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Project-Id: b60d10dba1d947cc97149a063a810129 Jun 30 12:39:39.382614 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Project-Name: tempest-AttachVolumeTestJSON-868731092 Jun 30 12:39:39.382614 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Role: member,reader Jun 30 12:39:39.382614 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Roles: member,reader Jun 30 12:39:39.384134 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/b60d10dba1d947cc97149a063a810129"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b60d10dba1d947cc97149a063a810129"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_b60d10dba1d947cc97149a063a810129", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b60d10dba1d947cc97149a063a810129"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 30 12:39:39.384134 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Tenant: tempest-AttachVolumeTestJSON-868731092 Jun 30 12:39:39.384134 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Tenant-Id: b60d10dba1d947cc97149a063a810129 Jun 30 12:39:39.384134 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Tenant-Name: tempest-AttachVolumeTestJSON-868731092 Jun 30 12:39:39.384134 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User: tempest-AttachVolumeTestJSON-868731092-project Jun 30 12:39:39.384134 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User-Domain-Id: default Jun 30 12:39:39.384134 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User-Domain-Name: Default Jun 30 12:39:39.384134 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User-Id: 6ddb38b4d6864a6c96b84c9a4092eea8 Jun 30 12:39:39.384134 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User-Name: tempest-AttachVolumeTestJSON-868731092-project Jun 30 12:39:39.384134 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: method: > Jun 30 12:39:39.384134 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: exception: Instance 99ba3b96-6700-41e0-b2cf-ff8933b2bf94 could not be found. Jun 30 12:39:39.384134 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: action_args: {'id': '99ba3b96-6700-41e0-b2cf-ff8933b2bf94'} Jun 30 12:39:39.385081 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 12:39:39.385081 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:39:39.385081 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 12:39:39.385081 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 12:39:39.385081 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 12:39:39.385081 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 12:39:39.385081 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 12:39:39.385081 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 12:39:39.385081 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 12:39:39.385081 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 12:39:39.385081 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99ba3b96-6700-41e0-b2cf-ff8933b2bf94 could not be found. Jun 30 12:39:39.385081 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:39:39.385081 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:39:39.385081 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:39:39.385081 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:39:39.385081 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:39:39.385081 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:39:39.385081 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 12:39:39.385081 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 12:39:39.385081 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 12:39:39.386529 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 12:39:39.386529 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 30 12:39:39.386529 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 30 12:39:39.386529 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 30 12:39:39.386529 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 30 12:39:39.386529 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 12:39:39.386529 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 12:39:39.386529 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 12:39:39.386529 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 12:39:39.386529 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99ba3b96-6700-41e0-b2cf-ff8933b2bf94 could not be found. Jun 30 12:39:39.386529 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:39:39.386529 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:39:39.386529 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:39:39.386529 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:39:39.386529 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:39:39.386529 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:39:39.386529 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 12:39:39.386529 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 12:39:39.386529 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99ba3b96-6700-41e0-b2cf-ff8933b2bf94 could not be found. Jun 30 12:39:39.386529 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:39:39.387903 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-f1474c1c-4d58-4f35-ab4f-9b747c39092a tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Returning 404 to user: Instance 99ba3b96-6700-41e0-b2cf-ff8933b2bf94 could not be found. {{(pid=124297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 12:39:39.387903 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-f1474c1c-4d58-4f35-ab4f-9b747c39092a tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "DELETE /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94" status: 404 len: 111 microversion: 2.1 time: 0.030527 Jun 30 12:39:39.387903 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 366/721] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 30 12:39:39 2022] DELETE /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 12:39:39.392562 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-f68264df-7695-4399-a8c6-e9a834ca348d tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:39:39.393205 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-f68264df-7695-4399-a8c6-e9a834ca348d tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] [instance: 99ba3b96-6700-41e0-b2cf-ff8933b2bf94] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:39:39.395625 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG dbcounter [-] [124298] Writing DB stats nova_api:SELECT=45,nova_api:DELETE=1 {{(pid=124298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:39:39.401643 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-f68264df-7695-4399-a8c6-e9a834ca348d tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:39.402095 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-f68264df-7695-4399-a8c6-e9a834ca348d tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:39.402866 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-f68264df-7695-4399-a8c6-e9a834ca348d tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:39.403309 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-f68264df-7695-4399-a8c6-e9a834ca348d tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:39.417732 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.wsgi [None req-f68264df-7695-4399-a8c6-e9a834ca348d tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] HTTP exception thrown: Instance 99ba3b96-6700-41e0-b2cf-ff8933b2bf94 could not be found. Jun 30 12:39:39.419248 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-f68264df-7695-4399-a8c6-e9a834ca348d tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Request method failure captured: Jun 30 12:39:39.419248 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: request: GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94 HTTP/1.1 Jun 30 12:39:39.419248 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Accept: application/json Jun 30 12:39:39.419248 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Accept-Encoding: identity Jun 30 12:39:39.419248 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Connection: close Jun 30 12:39:39.419248 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Content-Length: 0 Jun 30 12:39:39.419248 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Content-Type: application/json Jun 30 12:39:39.419248 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Host: 10.222.0.57 Jun 30 12:39:39.419248 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Openstack-System-Scope: None Jun 30 12:39:39.419248 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: User-Agent: python-urllib3/1.26.9 Jun 30 12:39:39.419248 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Auth-Token: gAAAAABivZf4l2uN2l7MZf1ZhxzVFfts0wg0_KMAarn_6hpljXzQrjCE_nI8N7K9WLga4GIDF0IaS7huxljiZYYC8_sdgJ99DASpal2KKCfcwxDzeH2kiKHCakZvOuVM8Hd3lglaApvXhJAuoMzyvjLzbCFt5-vglJcWrsab-0Ua-0r9pZ9hVWM Jun 30 12:39:39.419248 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Domain-Id: None Jun 30 12:39:39.419248 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Domain-Name: None Jun 30 12:39:39.419248 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Identity-Status: Confirmed Jun 30 12:39:39.419248 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Is-Admin-Project: True Jun 30 12:39:39.419248 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Domain-Id: default Jun 30 12:39:39.419248 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Domain-Name: Default Jun 30 12:39:39.419248 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Id: b60d10dba1d947cc97149a063a810129 Jun 30 12:39:39.419248 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Name: tempest-AttachVolumeTestJSON-868731092 Jun 30 12:39:39.419248 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Role: member,reader Jun 30 12:39:39.419248 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Roles: member,reader Jun 30 12:39:39.420741 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/b60d10dba1d947cc97149a063a810129"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b60d10dba1d947cc97149a063a810129"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_b60d10dba1d947cc97149a063a810129", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b60d10dba1d947cc97149a063a810129"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 30 12:39:39.420741 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant: tempest-AttachVolumeTestJSON-868731092 Jun 30 12:39:39.420741 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant-Id: b60d10dba1d947cc97149a063a810129 Jun 30 12:39:39.420741 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant-Name: tempest-AttachVolumeTestJSON-868731092 Jun 30 12:39:39.420741 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User: tempest-AttachVolumeTestJSON-868731092-project Jun 30 12:39:39.420741 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Domain-Id: default Jun 30 12:39:39.420741 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Domain-Name: Default Jun 30 12:39:39.420741 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Id: 6ddb38b4d6864a6c96b84c9a4092eea8 Jun 30 12:39:39.420741 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Name: tempest-AttachVolumeTestJSON-868731092-project Jun 30 12:39:39.420741 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: method: > Jun 30 12:39:39.420741 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: exception: Instance 99ba3b96-6700-41e0-b2cf-ff8933b2bf94 could not be found. Jun 30 12:39:39.420741 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: action_args: {'id': '99ba3b96-6700-41e0-b2cf-ff8933b2bf94'} Jun 30 12:39:39.421622 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 12:39:39.421622 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:39:39.421622 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 12:39:39.421622 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 12:39:39.421622 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 12:39:39.421622 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 12:39:39.421622 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 12:39:39.421622 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 12:39:39.421622 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 12:39:39.421622 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 12:39:39.421622 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99ba3b96-6700-41e0-b2cf-ff8933b2bf94 could not be found. Jun 30 12:39:39.421622 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:39:39.421622 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:39:39.421622 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:39:39.421622 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:39:39.421622 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:39:39.421622 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:39:39.421622 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 12:39:39.421622 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 12:39:39.421622 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 12:39:39.423048 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 12:39:39.423048 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 12:39:39.423048 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 12:39:39.423048 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 12:39:39.423048 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 12:39:39.423048 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 12:39:39.423048 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 12:39:39.423048 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99ba3b96-6700-41e0-b2cf-ff8933b2bf94 could not be found. Jun 30 12:39:39.423048 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:39:39.423048 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:39:39.423048 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:39:39.423048 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:39:39.423048 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:39:39.423048 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:39:39.423048 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 12:39:39.423048 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 12:39:39.423048 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99ba3b96-6700-41e0-b2cf-ff8933b2bf94 could not be found. Jun 30 12:39:39.423048 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:39:39.424317 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-f68264df-7695-4399-a8c6-e9a834ca348d tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] Returning 404 to user: Instance 99ba3b96-6700-41e0-b2cf-ff8933b2bf94 could not be found. {{(pid=124298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 12:39:39.424317 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-f68264df-7695-4399-a8c6-e9a834ca348d tempest-AttachVolumeTestJSON-868731092 tempest-AttachVolumeTestJSON-868731092-project] 10.222.0.57 "GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94" status: 404 len: 111 microversion: 2.1 time: 0.031985 Jun 30 12:39:39.424317 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 356/722] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:39:39 2022] GET /compute/v2.1/servers/99ba3b96-6700-41e0-b2cf-ff8933b2bf94 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 12:39:42.904242 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-5004b974-656b-422d-88d8-934b729d9756 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:39:42.904878 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-5004b974-656b-422d-88d8-934b729d9756 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: 8d6c9ce4-3de7-47d1-8e5a-1abe9091129e] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:39:42.912936 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-5004b974-656b-422d-88d8-934b729d9756 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:42.913391 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-5004b974-656b-422d-88d8-934b729d9756 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:42.914172 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-5004b974-656b-422d-88d8-934b729d9756 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:42.914602 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-5004b974-656b-422d-88d8-934b729d9756 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:42.940104 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-5004b974-656b-422d-88d8-934b729d9756 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e/ips" status: 200 len: 151 microversion: 2.20 time: 0.040206 Jun 30 12:39:42.940661 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 367/723] 10.222.0.57 () {60 vars in 1288 bytes} [Thu Jun 30 12:39:42 2022] GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e/ips => generated 151 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 12:39:45.704978 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-099943b6-f409-45f2-ab19-1560dd7fe263 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:39:45.705582 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-099943b6-f409-45f2-ab19-1560dd7fe263 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: 8d6c9ce4-3de7-47d1-8e5a-1abe9091129e] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:39:45.712885 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-099943b6-f409-45f2-ab19-1560dd7fe263 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:45.713337 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-099943b6-f409-45f2-ab19-1560dd7fe263 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:45.714093 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-099943b6-f409-45f2-ab19-1560dd7fe263 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:45.714518 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-099943b6-f409-45f2-ab19-1560dd7fe263 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:45.739717 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.objects.instance [None req-099943b6-f409-45f2-ab19-1560dd7fe263 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lazy-loading 'flavor' on Instance uuid 8d6c9ce4-3de7-47d1-8e5a-1abe9091129e {{(pid=124298) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 12:39:46.120858 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-099943b6-f409-45f2-ab19-1560dd7fe263 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "POST /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e/action" status: 202 len: 0 microversion: 2.20 time: 0.418946 Jun 30 12:39:46.123191 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 357/724] 10.222.0.57 () {62 vars in 1318 bytes} [Thu Jun 30 12:39:45 2022] POST /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e/action => generated 0 bytes in 423 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 30 12:39:46.133190 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-b0d557ab-3110-4778-8a64-ee17a099ba97 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:39:46.133772 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-b0d557ab-3110-4778-8a64-ee17a099ba97 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: 8d6c9ce4-3de7-47d1-8e5a-1abe9091129e] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:39:46.143615 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-b0d557ab-3110-4778-8a64-ee17a099ba97 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:46.144394 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-b0d557ab-3110-4778-8a64-ee17a099ba97 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:46.146461 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-b0d557ab-3110-4778-8a64-ee17a099ba97 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:46.147372 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-b0d557ab-3110-4778-8a64-ee17a099ba97 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:46.434483 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-b0d557ab-3110-4778-8a64-ee17a099ba97 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:39:46.447708 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-b0d557ab-3110-4778-8a64-ee17a099ba97 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:39:46.454109 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-b0d557ab-3110-4778-8a64-ee17a099ba97 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:39:46.457678 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-b0d557ab-3110-4778-8a64-ee17a099ba97 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e" status: 200 len: 1722 microversion: 2.20 time: 0.330087 Jun 30 12:39:46.458970 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 368/725] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:39:46 2022] GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e => generated 1722 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:39:47.479537 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-9f4005b3-024b-4146-9900-f052a06a4153 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:39:47.480239 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-9f4005b3-024b-4146-9900-f052a06a4153 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: 8d6c9ce4-3de7-47d1-8e5a-1abe9091129e] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:39:47.487260 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-9f4005b3-024b-4146-9900-f052a06a4153 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:47.487957 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-9f4005b3-024b-4146-9900-f052a06a4153 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:47.488795 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-9f4005b3-024b-4146-9900-f052a06a4153 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:47.489235 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-9f4005b3-024b-4146-9900-f052a06a4153 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:47.702701 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-9f4005b3-024b-4146-9900-f052a06a4153 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:39:47.718582 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-9f4005b3-024b-4146-9900-f052a06a4153 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:39:47.724607 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-9f4005b3-024b-4146-9900-f052a06a4153 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:39:47.725916 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-9f4005b3-024b-4146-9900-f052a06a4153 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e" status: 200 len: 1722 microversion: 2.20 time: 0.251635 Jun 30 12:39:47.726430 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 358/726] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:39:47 2022] GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e => generated 1722 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:39:48.245760 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-c63399e7-7718-482b-b752-d69d23de287c tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Action: 'create', calling method: .version_select at 0x7fd0e003f040>, body: {"keypair": {"name": "tempest-keypair-1459956002", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMo8pqEsfK7MybmrhJjBGc4+qNa82FG8j0P7JLnOUYPTkL3leoddrneVFYv3K0b9y8/IxTu3O0cvIeqmxsmlwFz3nVjjaOWxQZthefU+eWl5fns/u54lOMyiwTgTlXV2dw=="}} {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:39:48.262087 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.quota [None req-c63399e7-7718-482b-b752-d69d23de287c tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Getting quotas for project 359201313a944a8fa9881ee6fdea67e2. Resources: {'key_pairs'} {{(pid=124297) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 12:39:48.266383 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.quota [None req-c63399e7-7718-482b-b752-d69d23de287c tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Getting quotas for user e935f2637d124453947b3c78360567a5 and project 359201313a944a8fa9881ee6fdea67e2. Resources: {'key_pairs'} {{(pid=124297) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 12:39:48.293220 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-c63399e7-7718-482b-b752-d69d23de287c tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.192610 Jun 30 12:39:48.293818 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 369/727] 10.222.0.57 () {60 vars in 1158 bytes} [Thu Jun 30 12:39:48 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:39:48.744413 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-bc65355d-bac5-4321-9ca6-caaa82f00b3d tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:39:48.745317 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-bc65355d-bac5-4321-9ca6-caaa82f00b3d tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: 8d6c9ce4-3de7-47d1-8e5a-1abe9091129e] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:39:48.752393 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-bc65355d-bac5-4321-9ca6-caaa82f00b3d tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:48.752933 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-bc65355d-bac5-4321-9ca6-caaa82f00b3d tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:48.753712 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-bc65355d-bac5-4321-9ca6-caaa82f00b3d tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:48.754204 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-bc65355d-bac5-4321-9ca6-caaa82f00b3d tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:48.903747 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-bc65355d-bac5-4321-9ca6-caaa82f00b3d tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:39:48.914588 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-bc65355d-bac5-4321-9ca6-caaa82f00b3d tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:39:48.916198 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-bc65355d-bac5-4321-9ca6-caaa82f00b3d tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:39:48.917529 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-bc65355d-bac5-4321-9ca6-caaa82f00b3d tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e" status: 200 len: 1722 microversion: 2.20 time: 0.177142 Jun 30 12:39:48.918089 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 359/728] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:39:48 2022] GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:39:49.579657 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-6d019feb-dbaa-4026-a4a7-6d64441ad545 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2061873348", "imageRef": "776a1662-a241-4e20-9a9c-e4743c64efd0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0cf7ba00-1ef8-492b-b4f6-ee883e3dfe65"}], "security_groups": [{"name": "tempest-securitygroup--2034623585"}], "key_name": "tempest-keypair-1459956002", "user_data": "}} {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:39:49.685805 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.network.neutron [None req-6d019feb-dbaa-4026-a4a7-6d64441ad545 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] validate_networks() for [('0cf7ba00-1ef8-492b-b4f6-ee883e3dfe65', None, None, None, None, None)] {{(pid=124297) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 12:39:49.935394 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-6255f10d-593c-4b7f-a32f-12ca13fed596 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:39:49.935999 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-6255f10d-593c-4b7f-a32f-12ca13fed596 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: 8d6c9ce4-3de7-47d1-8e5a-1abe9091129e] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:39:49.945318 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-6255f10d-593c-4b7f-a32f-12ca13fed596 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:49.946101 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-6255f10d-593c-4b7f-a32f-12ca13fed596 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:49.947204 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-6255f10d-593c-4b7f-a32f-12ca13fed596 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:49.947801 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-6255f10d-593c-4b7f-a32f-12ca13fed596 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:50.150901 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.virt.hardware [None req-6d019feb-dbaa-4026-a4a7-6d64441ad545 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Flavor limits 0:0:0 {{(pid=124297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 12:39:50.151520 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.virt.hardware [None req-6d019feb-dbaa-4026-a4a7-6d64441ad545 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Image limits 0:0:0 {{(pid=124297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 12:39:50.152281 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.virt.hardware [None req-6d019feb-dbaa-4026-a4a7-6d64441ad545 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Flavor pref 0:0:0 {{(pid=124297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 12:39:50.152858 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.virt.hardware [None req-6d019feb-dbaa-4026-a4a7-6d64441ad545 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Image pref 0:0:0 {{(pid=124297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 12:39:50.153381 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.virt.hardware [None req-6d019feb-dbaa-4026-a4a7-6d64441ad545 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 12:39:50.163852 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-6d019feb-dbaa-4026-a4a7-6d64441ad545 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:50.164478 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-6d019feb-dbaa-4026-a4a7-6d64441ad545 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:50.165465 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-6d019feb-dbaa-4026-a4a7-6d64441ad545 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:50.166145 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-6d019feb-dbaa-4026-a4a7-6d64441ad545 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:50.184756 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-6255f10d-593c-4b7f-a32f-12ca13fed596 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:39:50.185934 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.quota [None req-6d019feb-dbaa-4026-a4a7-6d64441ad545 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Getting quotas for project 359201313a944a8fa9881ee6fdea67e2. Resources: {'cores', 'ram', 'instances'} {{(pid=124297) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 12:39:50.191367 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.quota [None req-6d019feb-dbaa-4026-a4a7-6d64441ad545 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Getting quotas for user e935f2637d124453947b3c78360567a5 and project 359201313a944a8fa9881ee6fdea67e2. Resources: {'cores', 'ram', 'instances'} {{(pid=124297) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 12:39:50.196105 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-6255f10d-593c-4b7f-a32f-12ca13fed596 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:39:50.197954 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-6255f10d-593c-4b7f-a32f-12ca13fed596 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:39:50.199310 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-6255f10d-593c-4b7f-a32f-12ca13fed596 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e" status: 200 len: 1722 microversion: 2.20 time: 0.267840 Jun 30 12:39:50.200741 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 360/729] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:39:49 2022] GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e => generated 1722 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 12:39:50.203675 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-6d019feb-dbaa-4026-a4a7-6d64441ad545 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Going to run 1 instances... {{(pid=124297) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 12:39:50.206066 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-6d019feb-dbaa-4026-a4a7-6d64441ad545 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: 2a572f38-474c-4395-a917-074c331a5cb7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='776a1662-a241-4e20-9a9c-e4743c64efd0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124297) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 12:39:50.254320 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-6d019feb-dbaa-4026-a4a7-6d64441ad545 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.678885 Jun 30 12:39:50.255469 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 370/730] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 30 12:39:49 2022] POST /compute/v2.1/servers => generated 402 bytes in 681 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 12:39:50.265803 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-f40a9ab3-eca0-42a1-9aaf-9ebaa713acab tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:39:50.277355 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-f40a9ab3-eca0-42a1-9aaf-9ebaa713acab tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: 2a572f38-474c-4395-a917-074c331a5cb7] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:39:50.353473 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-f40a9ab3-eca0-42a1-9aaf-9ebaa713acab tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e935f2637d124453947b3c78360567a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359201313a944a8fa9881ee6fdea67e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:39:50.364343 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-f40a9ab3-eca0-42a1-9aaf-9ebaa713acab tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "GET /compute/v2.1/servers/2a572f38-474c-4395-a917-074c331a5cb7" status: 200 len: 1242 microversion: 2.1 time: 0.102533 Jun 30 12:39:50.365527 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 361/731] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:39:50 2022] GET /compute/v2.1/servers/2a572f38-474c-4395-a917-074c331a5cb7 => generated 1242 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:39:51.218976 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-7f1b63dc-78a5-4b78-8528-069774ed96cc tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:39:51.219590 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-7f1b63dc-78a5-4b78-8528-069774ed96cc tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: 8d6c9ce4-3de7-47d1-8e5a-1abe9091129e] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:39:51.227820 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-7f1b63dc-78a5-4b78-8528-069774ed96cc tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:51.228263 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-7f1b63dc-78a5-4b78-8528-069774ed96cc tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:51.229068 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-7f1b63dc-78a5-4b78-8528-069774ed96cc tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:51.229494 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-7f1b63dc-78a5-4b78-8528-069774ed96cc tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:51.374325 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-7f1b63dc-78a5-4b78-8528-069774ed96cc tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:39:51.383849 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-ab7f90af-9b4a-45f7-9945-f14b209f8301 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:39:51.387415 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-ab7f90af-9b4a-45f7-9945-f14b209f8301 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: 2a572f38-474c-4395-a917-074c331a5cb7] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:39:51.393479 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-7f1b63dc-78a5-4b78-8528-069774ed96cc tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:39:51.394762 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-ab7f90af-9b4a-45f7-9945-f14b209f8301 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:51.395163 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-7f1b63dc-78a5-4b78-8528-069774ed96cc tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:39:51.395466 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-ab7f90af-9b4a-45f7-9945-f14b209f8301 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:51.396395 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-ab7f90af-9b4a-45f7-9945-f14b209f8301 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:51.396962 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-ab7f90af-9b4a-45f7-9945-f14b209f8301 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:51.397166 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-7f1b63dc-78a5-4b78-8528-069774ed96cc tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e" status: 200 len: 1722 microversion: 2.20 time: 0.182440 Jun 30 12:39:51.397679 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 371/732] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:39:51 2022] GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e => generated 1722 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:39:51.463376 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-ab7f90af-9b4a-45f7-9945-f14b209f8301 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e935f2637d124453947b3c78360567a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359201313a944a8fa9881ee6fdea67e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:39:51.472880 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-ab7f90af-9b4a-45f7-9945-f14b209f8301 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "GET /compute/v2.1/servers/2a572f38-474c-4395-a917-074c331a5cb7" status: 200 len: 1302 microversion: 2.1 time: 0.094517 Jun 30 12:39:51.473594 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 362/733] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:39:51 2022] GET /compute/v2.1/servers/2a572f38-474c-4395-a917-074c331a5cb7 => generated 1302 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:39:52.415629 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-61dd2a3e-edb2-4663-a476-34cde1d5a885 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:39:52.416867 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-61dd2a3e-edb2-4663-a476-34cde1d5a885 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: 8d6c9ce4-3de7-47d1-8e5a-1abe9091129e] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:39:52.423628 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-61dd2a3e-edb2-4663-a476-34cde1d5a885 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:52.424058 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-61dd2a3e-edb2-4663-a476-34cde1d5a885 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:52.424848 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-61dd2a3e-edb2-4663-a476-34cde1d5a885 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:52.425280 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-61dd2a3e-edb2-4663-a476-34cde1d5a885 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:52.490618 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-004b31c3-7805-4ef8-921c-7b44274a0465 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:39:52.491228 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-004b31c3-7805-4ef8-921c-7b44274a0465 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: 2a572f38-474c-4395-a917-074c331a5cb7] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:39:52.497812 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-004b31c3-7805-4ef8-921c-7b44274a0465 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:52.498253 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-004b31c3-7805-4ef8-921c-7b44274a0465 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:52.499015 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-004b31c3-7805-4ef8-921c-7b44274a0465 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:52.499448 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-004b31c3-7805-4ef8-921c-7b44274a0465 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:52.686954 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-61dd2a3e-edb2-4663-a476-34cde1d5a885 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:39:52.695825 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-61dd2a3e-edb2-4663-a476-34cde1d5a885 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:39:52.697368 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-61dd2a3e-edb2-4663-a476-34cde1d5a885 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:39:52.698518 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-61dd2a3e-edb2-4663-a476-34cde1d5a885 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e" status: 200 len: 1722 microversion: 2.20 time: 0.286812 Jun 30 12:39:52.699068 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 372/734] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:39:52 2022] GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e => generated 1722 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 12:39:52.772679 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-004b31c3-7805-4ef8-921c-7b44274a0465 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e935f2637d124453947b3c78360567a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359201313a944a8fa9881ee6fdea67e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:39:52.781692 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-004b31c3-7805-4ef8-921c-7b44274a0465 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "GET /compute/v2.1/servers/2a572f38-474c-4395-a917-074c331a5cb7" status: 200 len: 1368 microversion: 2.1 time: 0.294583 Jun 30 12:39:52.782360 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 363/735] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:39:52 2022] GET /compute/v2.1/servers/2a572f38-474c-4395-a917-074c331a5cb7 => generated 1368 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:39:53.091283 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [req-3d6347ae-8cdf-4480-a224-591d36d7d2cc req-8adfab21-e4f6-453d-818e-3a8e0f14c4c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a572f38-474c-4395-a917-074c331a5cb7", "tag": "ce1f7c34-caf7-484b-a606-a9941e441752"}]} {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:39:53.103905 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [req-3d6347ae-8cdf-4480-a224-591d36d7d2cc req-8adfab21-e4f6-453d-818e-3a8e0f14c4c0 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:53.104316 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [req-3d6347ae-8cdf-4480-a224-591d36d7d2cc req-8adfab21-e4f6-453d-818e-3a8e0f14c4c0 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:53.118129 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.compute.server_external_events [req-3d6347ae-8cdf-4480-a224-591d36d7d2cc req-8adfab21-e4f6-453d-818e-3a8e0f14c4c0 service nova] Creating event network-changed:ce1f7c34-caf7-484b-a606-a9941e441752 for instance 2a572f38-474c-4395-a917-074c331a5cb7 on hv-cinder-84614 Jun 30 12:39:53.123362 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [req-3d6347ae-8cdf-4480-a224-591d36d7d2cc req-8adfab21-e4f6-453d-818e-3a8e0f14c4c0 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037716 Jun 30 12:39:53.124347 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 373/736] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 30 12:39:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:39:53.719305 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-88c1b12e-0aed-4601-94c3-fa2fb85877d2 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:39:53.719903 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-88c1b12e-0aed-4601-94c3-fa2fb85877d2 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: 8d6c9ce4-3de7-47d1-8e5a-1abe9091129e] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:39:53.730037 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-88c1b12e-0aed-4601-94c3-fa2fb85877d2 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:53.730685 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-88c1b12e-0aed-4601-94c3-fa2fb85877d2 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:53.731729 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-88c1b12e-0aed-4601-94c3-fa2fb85877d2 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:53.732328 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-88c1b12e-0aed-4601-94c3-fa2fb85877d2 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:53.806798 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-2eaa93c4-a4ba-4046-aafa-95df4dbe682f tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:39:53.807464 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-2eaa93c4-a4ba-4046-aafa-95df4dbe682f tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: 2a572f38-474c-4395-a917-074c331a5cb7] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:39:53.814476 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-2eaa93c4-a4ba-4046-aafa-95df4dbe682f tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:53.814932 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-2eaa93c4-a4ba-4046-aafa-95df4dbe682f tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:53.815701 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-2eaa93c4-a4ba-4046-aafa-95df4dbe682f tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:53.816136 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-2eaa93c4-a4ba-4046-aafa-95df4dbe682f tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:53.984879 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-88c1b12e-0aed-4601-94c3-fa2fb85877d2 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:39:53.993114 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-88c1b12e-0aed-4601-94c3-fa2fb85877d2 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:39:53.994658 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-88c1b12e-0aed-4601-94c3-fa2fb85877d2 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:39:53.995825 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-88c1b12e-0aed-4601-94c3-fa2fb85877d2 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e" status: 200 len: 1722 microversion: 2.20 time: 0.282201 Jun 30 12:39:53.996573 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 364/737] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:39:53 2022] GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e => generated 1722 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:39:54.011408 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-2eaa93c4-a4ba-4046-aafa-95df4dbe682f tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e935f2637d124453947b3c78360567a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359201313a944a8fa9881ee6fdea67e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:39:54.019791 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-2eaa93c4-a4ba-4046-aafa-95df4dbe682f tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "GET /compute/v2.1/servers/2a572f38-474c-4395-a917-074c331a5cb7" status: 200 len: 1368 microversion: 2.1 time: 0.217267 Jun 30 12:39:54.020471 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 374/738] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:39:53 2022] GET /compute/v2.1/servers/2a572f38-474c-4395-a917-074c331a5cb7 => generated 1368 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:39:55.014447 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-2a5e1849-4b1d-4736-97d8-f71085b3567d tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:39:55.015010 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-2a5e1849-4b1d-4736-97d8-f71085b3567d tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: 8d6c9ce4-3de7-47d1-8e5a-1abe9091129e] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:39:55.021771 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-2a5e1849-4b1d-4736-97d8-f71085b3567d tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:55.022692 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-2a5e1849-4b1d-4736-97d8-f71085b3567d tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:55.023662 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-2a5e1849-4b1d-4736-97d8-f71085b3567d tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:55.024068 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-2a5e1849-4b1d-4736-97d8-f71085b3567d tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:55.037438 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-954497fd-9390-4ab1-a72d-fbe534cb8f14 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:39:55.038448 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-954497fd-9390-4ab1-a72d-fbe534cb8f14 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: 2a572f38-474c-4395-a917-074c331a5cb7] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:39:55.044561 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-954497fd-9390-4ab1-a72d-fbe534cb8f14 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:55.045271 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-954497fd-9390-4ab1-a72d-fbe534cb8f14 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:55.046038 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-954497fd-9390-4ab1-a72d-fbe534cb8f14 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:55.046626 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-954497fd-9390-4ab1-a72d-fbe534cb8f14 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:55.346822 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-2a5e1849-4b1d-4736-97d8-f71085b3567d tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:39:55.349445 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-954497fd-9390-4ab1-a72d-fbe534cb8f14 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e935f2637d124453947b3c78360567a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359201313a944a8fa9881ee6fdea67e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:39:55.356007 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-2a5e1849-4b1d-4736-97d8-f71085b3567d tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:39:55.357825 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-954497fd-9390-4ab1-a72d-fbe534cb8f14 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "GET /compute/v2.1/servers/2a572f38-474c-4395-a917-074c331a5cb7" status: 200 len: 1368 microversion: 2.1 time: 0.324156 Jun 30 12:39:55.358247 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-2a5e1849-4b1d-4736-97d8-f71085b3567d tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:39:55.359656 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-2a5e1849-4b1d-4736-97d8-f71085b3567d tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e" status: 200 len: 1722 microversion: 2.20 time: 0.349298 Jun 30 12:39:55.368066 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 375/739] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:39:55 2022] GET /compute/v2.1/servers/2a572f38-474c-4395-a917-074c331a5cb7 => generated 1368 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 12:39:55.370439 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 365/740] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:39:55 2022] GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e => generated 1722 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:39:56.379501 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-4a152676-1af2-431a-9245-ad0c150b4d37 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:39:56.380326 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-4a152676-1af2-431a-9245-ad0c150b4d37 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: 2a572f38-474c-4395-a917-074c331a5cb7] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:39:56.382040 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-79ddb65b-8a32-4613-b947-a4ca81590bdb tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:39:56.382629 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-79ddb65b-8a32-4613-b947-a4ca81590bdb tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: 8d6c9ce4-3de7-47d1-8e5a-1abe9091129e] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:39:56.388429 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-4a152676-1af2-431a-9245-ad0c150b4d37 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:56.388901 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-4a152676-1af2-431a-9245-ad0c150b4d37 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:56.389638 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-79ddb65b-8a32-4613-b947-a4ca81590bdb tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:56.389784 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-4a152676-1af2-431a-9245-ad0c150b4d37 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:56.390074 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-4a152676-1af2-431a-9245-ad0c150b4d37 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:56.390217 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-79ddb65b-8a32-4613-b947-a4ca81590bdb tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:56.390845 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-79ddb65b-8a32-4613-b947-a4ca81590bdb tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:56.391278 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-79ddb65b-8a32-4613-b947-a4ca81590bdb tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:56.392763 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG dbcounter [-] [124297] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:39:56.593722 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-4a152676-1af2-431a-9245-ad0c150b4d37 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e935f2637d124453947b3c78360567a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359201313a944a8fa9881ee6fdea67e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:39:56.601415 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-79ddb65b-8a32-4613-b947-a4ca81590bdb tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:39:56.606243 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-4a152676-1af2-431a-9245-ad0c150b4d37 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "GET /compute/v2.1/servers/2a572f38-474c-4395-a917-074c331a5cb7" status: 200 len: 1368 microversion: 2.1 time: 0.233831 Jun 30 12:39:56.607007 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 376/741] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:39:56 2022] GET /compute/v2.1/servers/2a572f38-474c-4395-a917-074c331a5cb7 => generated 1368 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:39:56.613738 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-79ddb65b-8a32-4613-b947-a4ca81590bdb tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:39:56.615971 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-79ddb65b-8a32-4613-b947-a4ca81590bdb tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:39:56.617249 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-79ddb65b-8a32-4613-b947-a4ca81590bdb tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e" status: 200 len: 1722 microversion: 2.20 time: 0.242096 Jun 30 12:39:56.617772 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 366/742] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:39:56 2022] GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e => generated 1722 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:39:57.630930 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-4c436794-ccf6-4cd9-9d6a-8d8db5edd40d tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:39:57.631925 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-4c436794-ccf6-4cd9-9d6a-8d8db5edd40d tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: 2a572f38-474c-4395-a917-074c331a5cb7] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:39:57.636483 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-517ce55f-2902-4fb7-9a5b-32f37f1e54bb tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:39:57.637129 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-517ce55f-2902-4fb7-9a5b-32f37f1e54bb tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: 8d6c9ce4-3de7-47d1-8e5a-1abe9091129e] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:39:57.638896 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-4c436794-ccf6-4cd9-9d6a-8d8db5edd40d tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:57.639431 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-4c436794-ccf6-4cd9-9d6a-8d8db5edd40d tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:57.640208 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-4c436794-ccf6-4cd9-9d6a-8d8db5edd40d tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:57.640667 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-4c436794-ccf6-4cd9-9d6a-8d8db5edd40d tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:57.644078 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-517ce55f-2902-4fb7-9a5b-32f37f1e54bb tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:57.644795 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-517ce55f-2902-4fb7-9a5b-32f37f1e54bb tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:57.645338 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-517ce55f-2902-4fb7-9a5b-32f37f1e54bb tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:57.645780 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-517ce55f-2902-4fb7-9a5b-32f37f1e54bb tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:57.836091 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-4c436794-ccf6-4cd9-9d6a-8d8db5edd40d tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e935f2637d124453947b3c78360567a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359201313a944a8fa9881ee6fdea67e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:39:57.839183 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-517ce55f-2902-4fb7-9a5b-32f37f1e54bb tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:39:57.843925 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-4c436794-ccf6-4cd9-9d6a-8d8db5edd40d tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "GET /compute/v2.1/servers/2a572f38-474c-4395-a917-074c331a5cb7" status: 200 len: 1368 microversion: 2.1 time: 0.219475 Jun 30 12:39:57.844401 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 377/743] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:39:57 2022] GET /compute/v2.1/servers/2a572f38-474c-4395-a917-074c331a5cb7 => generated 1368 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:39:57.847393 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-517ce55f-2902-4fb7-9a5b-32f37f1e54bb tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:39:57.848928 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-517ce55f-2902-4fb7-9a5b-32f37f1e54bb tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:39:57.850123 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-517ce55f-2902-4fb7-9a5b-32f37f1e54bb tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e" status: 200 len: 1743 microversion: 2.20 time: 0.217586 Jun 30 12:39:57.850753 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 367/744] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:39:57 2022] GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e => generated 1743 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:39:58.864118 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-74b834eb-9e3e-49ef-9d7e-46bbc527ce96 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:39:58.865474 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-74b834eb-9e3e-49ef-9d7e-46bbc527ce96 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: 2a572f38-474c-4395-a917-074c331a5cb7] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:39:58.870144 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-0c0edbf6-2977-4895-a2ea-cb3f3e38fe6f tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:39:58.870827 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-0c0edbf6-2977-4895-a2ea-cb3f3e38fe6f tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: 8d6c9ce4-3de7-47d1-8e5a-1abe9091129e] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:39:58.873861 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-74b834eb-9e3e-49ef-9d7e-46bbc527ce96 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:58.874153 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-74b834eb-9e3e-49ef-9d7e-46bbc527ce96 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:58.874889 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-74b834eb-9e3e-49ef-9d7e-46bbc527ce96 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:58.875494 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-74b834eb-9e3e-49ef-9d7e-46bbc527ce96 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:58.882721 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-0c0edbf6-2977-4895-a2ea-cb3f3e38fe6f tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:58.883401 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-0c0edbf6-2977-4895-a2ea-cb3f3e38fe6f tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:58.884331 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-0c0edbf6-2977-4895-a2ea-cb3f3e38fe6f tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:58.884944 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-0c0edbf6-2977-4895-a2ea-cb3f3e38fe6f tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:59.080563 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-74b834eb-9e3e-49ef-9d7e-46bbc527ce96 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e935f2637d124453947b3c78360567a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359201313a944a8fa9881ee6fdea67e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:39:59.083128 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-0c0edbf6-2977-4895-a2ea-cb3f3e38fe6f tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:39:59.094260 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-74b834eb-9e3e-49ef-9d7e-46bbc527ce96 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "GET /compute/v2.1/servers/2a572f38-474c-4395-a917-074c331a5cb7" status: 200 len: 1368 microversion: 2.1 time: 0.235459 Jun 30 12:39:59.094850 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 378/745] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:39:58 2022] GET /compute/v2.1/servers/2a572f38-474c-4395-a917-074c331a5cb7 => generated 1368 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:39:59.101150 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-0c0edbf6-2977-4895-a2ea-cb3f3e38fe6f tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:39:59.102757 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-0c0edbf6-2977-4895-a2ea-cb3f3e38fe6f tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:39:59.103932 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-0c0edbf6-2977-4895-a2ea-cb3f3e38fe6f tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e" status: 200 len: 1743 microversion: 2.20 time: 0.238999 Jun 30 12:39:59.104485 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 368/746] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:39:58 2022] GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e => generated 1743 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:39:59.108164 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [req-17c0f8f8-8643-4a0e-b762-2b6524092933 req-d4f3e7aa-d897-475b-9394-704847a39150 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a572f38-474c-4395-a917-074c331a5cb7", "name": "network-vif-plugged", "status": "completed", "tag": "ce1f7c34-caf7-484b-a606-a9941e441752"}]} {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:39:59.116463 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [req-17c0f8f8-8643-4a0e-b762-2b6524092933 req-d4f3e7aa-d897-475b-9394-704847a39150 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:39:59.116923 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [req-17c0f8f8-8643-4a0e-b762-2b6524092933 req-d4f3e7aa-d897-475b-9394-704847a39150 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:39:59.127818 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.compute.server_external_events [req-17c0f8f8-8643-4a0e-b762-2b6524092933 req-d4f3e7aa-d897-475b-9394-704847a39150 service nova] Creating event network-vif-plugged:ce1f7c34-caf7-484b-a606-a9941e441752 for instance 2a572f38-474c-4395-a917-074c331a5cb7 on hv-cinder-84614 Jun 30 12:39:59.132849 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [req-17c0f8f8-8643-4a0e-b762-2b6524092933 req-d4f3e7aa-d897-475b-9394-704847a39150 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036822 Jun 30 12:39:59.133517 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 379/747] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 30 12:39:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:40:00.112042 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-8a8512fc-e8de-41fe-af01-59e2b5981505 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:40:00.112659 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-8a8512fc-e8de-41fe-af01-59e2b5981505 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: 2a572f38-474c-4395-a917-074c331a5cb7] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:40:00.120045 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-8a8512fc-e8de-41fe-af01-59e2b5981505 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:00.120500 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-8a8512fc-e8de-41fe-af01-59e2b5981505 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:00.121301 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-8a8512fc-e8de-41fe-af01-59e2b5981505 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:00.121752 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-8a8512fc-e8de-41fe-af01-59e2b5981505 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:00.123774 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-62b1fefd-84ba-4e1d-9637-1d7c43c162c6 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:40:00.124512 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-62b1fefd-84ba-4e1d-9637-1d7c43c162c6 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: 8d6c9ce4-3de7-47d1-8e5a-1abe9091129e] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:40:00.126004 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG dbcounter [-] [124298] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:40:00.131125 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-62b1fefd-84ba-4e1d-9637-1d7c43c162c6 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:00.131582 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-62b1fefd-84ba-4e1d-9637-1d7c43c162c6 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:00.132354 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-62b1fefd-84ba-4e1d-9637-1d7c43c162c6 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:00.132818 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-62b1fefd-84ba-4e1d-9637-1d7c43c162c6 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:00.176567 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG dbcounter [-] [124297] Writing DB stats nova_cell0:SELECT=2 {{(pid=124297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:40:00.198310 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG dbcounter [-] [124297] Writing DB stats nova_cell0:SELECT=10 {{(pid=124297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:40:00.323662 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-8a8512fc-e8de-41fe-af01-59e2b5981505 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e935f2637d124453947b3c78360567a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359201313a944a8fa9881ee6fdea67e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:00.330479 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-62b1fefd-84ba-4e1d-9637-1d7c43c162c6 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:00.338582 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-8a8512fc-e8de-41fe-af01-59e2b5981505 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "GET /compute/v2.1/servers/2a572f38-474c-4395-a917-074c331a5cb7" status: 200 len: 1368 microversion: 2.1 time: 0.230441 Jun 30 12:40:00.339251 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-62b1fefd-84ba-4e1d-9637-1d7c43c162c6 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:00.340790 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-62b1fefd-84ba-4e1d-9637-1d7c43c162c6 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:00.341333 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 369/748] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:40:00 2022] GET /compute/v2.1/servers/2a572f38-474c-4395-a917-074c331a5cb7 => generated 1368 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:40:00.342206 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-62b1fefd-84ba-4e1d-9637-1d7c43c162c6 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e" status: 200 len: 1738 microversion: 2.20 time: 0.223479 Jun 30 12:40:00.342913 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 380/749] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:40:00 2022] GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e => generated 1738 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:40:01.148260 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [req-0a8a5cd5-4475-4ce9-a71e-49b550d1f1f3 req-75199542-c22f-4d15-bae0-4627fc1346e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d6c9ce4-3de7-47d1-8e5a-1abe9091129e", "name": "network-vif-plugged", "status": "completed", "tag": "f52ef586-26d4-4590-b973-a09504ba1350"}]} {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:40:01.158207 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG dbcounter [-] [124298] Writing DB stats nova_cell0:SELECT=2 {{(pid=124298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:40:01.163456 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [req-0a8a5cd5-4475-4ce9-a71e-49b550d1f1f3 req-75199542-c22f-4d15-bae0-4627fc1346e4 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:01.164070 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [req-0a8a5cd5-4475-4ce9-a71e-49b550d1f1f3 req-75199542-c22f-4d15-bae0-4627fc1346e4 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:01.182319 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.compute.server_external_events [req-0a8a5cd5-4475-4ce9-a71e-49b550d1f1f3 req-75199542-c22f-4d15-bae0-4627fc1346e4 service nova] Creating event network-vif-plugged:f52ef586-26d4-4590-b973-a09504ba1350 for instance 8d6c9ce4-3de7-47d1-8e5a-1abe9091129e on hv-cinder-84614 Jun 30 12:40:01.189265 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [req-0a8a5cd5-4475-4ce9-a71e-49b550d1f1f3 req-75199542-c22f-4d15-bae0-4627fc1346e4 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044601 Jun 30 12:40:01.190071 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 370/750] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 30 12:40:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 12:40:01.363211 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-7521c284-9cf9-4433-b94e-41a65d74fa86 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:40:01.363909 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-7521c284-9cf9-4433-b94e-41a65d74fa86 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: 8d6c9ce4-3de7-47d1-8e5a-1abe9091129e] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:40:01.369866 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-68326619-2b27-46d0-ab06-b20e838573bb tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:40:01.371172 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-68326619-2b27-46d0-ab06-b20e838573bb tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: 2a572f38-474c-4395-a917-074c331a5cb7] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:40:01.386770 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-7521c284-9cf9-4433-b94e-41a65d74fa86 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:01.387798 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-68326619-2b27-46d0-ab06-b20e838573bb tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:01.388756 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-7521c284-9cf9-4433-b94e-41a65d74fa86 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:01.389368 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-68326619-2b27-46d0-ab06-b20e838573bb tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:01.390318 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-7521c284-9cf9-4433-b94e-41a65d74fa86 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:01.391302 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-68326619-2b27-46d0-ab06-b20e838573bb tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:01.391896 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-7521c284-9cf9-4433-b94e-41a65d74fa86 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:01.392478 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-68326619-2b27-46d0-ab06-b20e838573bb tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:01.631791 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-7521c284-9cf9-4433-b94e-41a65d74fa86 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:01.636477 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-68326619-2b27-46d0-ab06-b20e838573bb tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e935f2637d124453947b3c78360567a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359201313a944a8fa9881ee6fdea67e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:01.645116 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-68326619-2b27-46d0-ab06-b20e838573bb tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "GET /compute/v2.1/servers/2a572f38-474c-4395-a917-074c331a5cb7" status: 200 len: 1557 microversion: 2.1 time: 0.291893 Jun 30 12:40:01.649135 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 381/751] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:40:01 2022] GET /compute/v2.1/servers/2a572f38-474c-4395-a917-074c331a5cb7 => generated 1557 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:40:01.649789 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-7521c284-9cf9-4433-b94e-41a65d74fa86 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:01.654414 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-7521c284-9cf9-4433-b94e-41a65d74fa86 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:01.656166 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-7521c284-9cf9-4433-b94e-41a65d74fa86 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e" status: 200 len: 1738 microversion: 2.20 time: 0.297259 Jun 30 12:40:01.656987 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 371/752] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:40:01 2022] GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e => generated 1738 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:40:01.672924 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-73083910-e248-4512-b6d0-235d0f04bce3 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:40:01.673448 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-73083910-e248-4512-b6d0-235d0f04bce3 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: 2a572f38-474c-4395-a917-074c331a5cb7] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:40:01.679923 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-73083910-e248-4512-b6d0-235d0f04bce3 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:01.680575 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-73083910-e248-4512-b6d0-235d0f04bce3 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:01.681602 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-73083910-e248-4512-b6d0-235d0f04bce3 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:01.682224 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-73083910-e248-4512-b6d0-235d0f04bce3 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:01.768864 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-73083910-e248-4512-b6d0-235d0f04bce3 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "GET /compute/v2.1/servers/2a572f38-474c-4395-a917-074c331a5cb7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.110360 Jun 30 12:40:01.769569 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 382/753] 10.222.0.57 () {58 vars in 1274 bytes} [Thu Jun 30 12:40:01 2022] GET /compute/v2.1/servers/2a572f38-474c-4395-a917-074c331a5cb7/os-interface => generated 284 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 12:40:02.688890 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-563c6fe5-dff4-4783-8e7e-ef557d72a931 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:40:02.689587 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-563c6fe5-dff4-4783-8e7e-ef557d72a931 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: 8d6c9ce4-3de7-47d1-8e5a-1abe9091129e] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:40:02.702785 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-563c6fe5-dff4-4783-8e7e-ef557d72a931 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:02.703134 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-563c6fe5-dff4-4783-8e7e-ef557d72a931 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:02.706506 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-563c6fe5-dff4-4783-8e7e-ef557d72a931 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:02.707001 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-563c6fe5-dff4-4783-8e7e-ef557d72a931 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:02.897832 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [req-f42343e1-258c-4b6a-a58f-f1a18a52e83a req-f6916c58-c88f-4662-8598-0ca52820c556 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a572f38-474c-4395-a917-074c331a5cb7", "tag": "ce1f7c34-caf7-484b-a606-a9941e441752"}]} {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:40:02.919430 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [req-f42343e1-258c-4b6a-a58f-f1a18a52e83a req-f6916c58-c88f-4662-8598-0ca52820c556 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:02.920239 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [req-f42343e1-258c-4b6a-a58f-f1a18a52e83a req-f6916c58-c88f-4662-8598-0ca52820c556 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:02.934407 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.compute.server_external_events [req-f42343e1-258c-4b6a-a58f-f1a18a52e83a req-f6916c58-c88f-4662-8598-0ca52820c556 service nova] Creating event network-changed:ce1f7c34-caf7-484b-a606-a9941e441752 for instance 2a572f38-474c-4395-a917-074c331a5cb7 on hv-cinder-84614 Jun 30 12:40:02.942591 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [req-f42343e1-258c-4b6a-a58f-f1a18a52e83a req-f6916c58-c88f-4662-8598-0ca52820c556 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052956 Jun 30 12:40:02.943552 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 383/754] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 30 12:40:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:40:02.982205 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-563c6fe5-dff4-4783-8e7e-ef557d72a931 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:02.994046 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-563c6fe5-dff4-4783-8e7e-ef557d72a931 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:02.995576 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-563c6fe5-dff4-4783-8e7e-ef557d72a931 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:02.996822 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-563c6fe5-dff4-4783-8e7e-ef557d72a931 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e" status: 200 len: 1738 microversion: 2.20 time: 0.319546 Jun 30 12:40:03.008251 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 372/755] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:40:02 2022] GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e => generated 1738 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:40:04.017628 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-e0c583b0-6c24-4e1b-b69f-fb444b6b125e tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:40:04.018424 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-e0c583b0-6c24-4e1b-b69f-fb444b6b125e tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: 8d6c9ce4-3de7-47d1-8e5a-1abe9091129e] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:40:04.028821 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-e0c583b0-6c24-4e1b-b69f-fb444b6b125e tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:04.029364 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-e0c583b0-6c24-4e1b-b69f-fb444b6b125e tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:04.033133 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-e0c583b0-6c24-4e1b-b69f-fb444b6b125e tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:04.033824 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-e0c583b0-6c24-4e1b-b69f-fb444b6b125e tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:04.210730 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-e0c583b0-6c24-4e1b-b69f-fb444b6b125e tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:04.223958 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-e0c583b0-6c24-4e1b-b69f-fb444b6b125e tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:04.225502 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-e0c583b0-6c24-4e1b-b69f-fb444b6b125e tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:04.226851 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-e0c583b0-6c24-4e1b-b69f-fb444b6b125e tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e" status: 200 len: 1738 microversion: 2.20 time: 0.215258 Jun 30 12:40:04.241759 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 384/756] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:40:04 2022] GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e => generated 1738 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:40:05.245837 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-cc988312-f9d8-4509-991a-6af0bc711a27 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:40:05.247138 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-cc988312-f9d8-4509-991a-6af0bc711a27 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: 8d6c9ce4-3de7-47d1-8e5a-1abe9091129e] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:40:05.254991 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-cc988312-f9d8-4509-991a-6af0bc711a27 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:05.255738 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-cc988312-f9d8-4509-991a-6af0bc711a27 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:05.256496 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-cc988312-f9d8-4509-991a-6af0bc711a27 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:05.257096 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-cc988312-f9d8-4509-991a-6af0bc711a27 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:05.407086 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-cc988312-f9d8-4509-991a-6af0bc711a27 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:05.415373 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-cc988312-f9d8-4509-991a-6af0bc711a27 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:05.417073 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-cc988312-f9d8-4509-991a-6af0bc711a27 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:05.418248 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-cc988312-f9d8-4509-991a-6af0bc711a27 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e" status: 200 len: 1738 microversion: 2.20 time: 0.177146 Jun 30 12:40:05.418814 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 373/757] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:40:05 2022] GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e => generated 1738 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:40:06.439145 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-cc1e31c5-8a16-4c3b-b506-e828ed9ae3e3 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:40:06.439776 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-cc1e31c5-8a16-4c3b-b506-e828ed9ae3e3 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: 8d6c9ce4-3de7-47d1-8e5a-1abe9091129e] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:40:06.449425 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-cc1e31c5-8a16-4c3b-b506-e828ed9ae3e3 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:06.450469 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-cc1e31c5-8a16-4c3b-b506-e828ed9ae3e3 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:06.450982 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-cc1e31c5-8a16-4c3b-b506-e828ed9ae3e3 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:06.451419 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-cc1e31c5-8a16-4c3b-b506-e828ed9ae3e3 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:06.599579 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-cc1e31c5-8a16-4c3b-b506-e828ed9ae3e3 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:06.611819 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-cc1e31c5-8a16-4c3b-b506-e828ed9ae3e3 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:06.613635 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-cc1e31c5-8a16-4c3b-b506-e828ed9ae3e3 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:06.614936 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-cc1e31c5-8a16-4c3b-b506-e828ed9ae3e3 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e" status: 200 len: 1738 microversion: 2.20 time: 0.179764 Jun 30 12:40:06.615615 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 385/758] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:40:06 2022] GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e => generated 1738 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:40:07.635398 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-8bf0f8f3-32ee-4929-a9dd-d262c3ad81c9 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:40:07.636899 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-8bf0f8f3-32ee-4929-a9dd-d262c3ad81c9 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: 8d6c9ce4-3de7-47d1-8e5a-1abe9091129e] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:40:07.643978 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-8bf0f8f3-32ee-4929-a9dd-d262c3ad81c9 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:07.644710 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-8bf0f8f3-32ee-4929-a9dd-d262c3ad81c9 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:07.646522 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-8bf0f8f3-32ee-4929-a9dd-d262c3ad81c9 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:07.647776 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-8bf0f8f3-32ee-4929-a9dd-d262c3ad81c9 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:07.797018 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-8bf0f8f3-32ee-4929-a9dd-d262c3ad81c9 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:07.807604 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-8bf0f8f3-32ee-4929-a9dd-d262c3ad81c9 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:07.809268 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-8bf0f8f3-32ee-4929-a9dd-d262c3ad81c9 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:07.810560 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-8bf0f8f3-32ee-4929-a9dd-d262c3ad81c9 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e" status: 200 len: 1738 microversion: 2.20 time: 0.181093 Jun 30 12:40:07.811515 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 374/759] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:40:07 2022] GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e => generated 1738 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:40:08.828863 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-b8ee308d-5ab7-43cd-b0a0-261ac950d3c3 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:40:08.830365 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-b8ee308d-5ab7-43cd-b0a0-261ac950d3c3 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: 8d6c9ce4-3de7-47d1-8e5a-1abe9091129e] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:40:08.834785 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG dbcounter [-] [124297] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=4 {{(pid=124297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:40:08.841605 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-b8ee308d-5ab7-43cd-b0a0-261ac950d3c3 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:08.842370 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-b8ee308d-5ab7-43cd-b0a0-261ac950d3c3 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:08.843211 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-b8ee308d-5ab7-43cd-b0a0-261ac950d3c3 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:08.843714 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-b8ee308d-5ab7-43cd-b0a0-261ac950d3c3 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:08.990988 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-b8ee308d-5ab7-43cd-b0a0-261ac950d3c3 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:09.003942 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-b8ee308d-5ab7-43cd-b0a0-261ac950d3c3 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:09.005508 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-b8ee308d-5ab7-43cd-b0a0-261ac950d3c3 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:09.006924 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-b8ee308d-5ab7-43cd-b0a0-261ac950d3c3 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e" status: 200 len: 1738 microversion: 2.20 time: 0.181971 Jun 30 12:40:09.007486 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 386/760] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:40:08 2022] GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e => generated 1738 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:40:10.025166 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-1c782081-2fbc-4571-840b-924f2feade8f tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:40:10.025850 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-1c782081-2fbc-4571-840b-924f2feade8f tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: 8d6c9ce4-3de7-47d1-8e5a-1abe9091129e] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:40:10.028697 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG dbcounter [-] [124298] Writing DB stats nova_api:SELECT=40 {{(pid=124298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:40:10.034778 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-1c782081-2fbc-4571-840b-924f2feade8f tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:10.035230 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-1c782081-2fbc-4571-840b-924f2feade8f tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:10.036001 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-1c782081-2fbc-4571-840b-924f2feade8f tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:10.036435 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-1c782081-2fbc-4571-840b-924f2feade8f tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:10.182266 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-1c782081-2fbc-4571-840b-924f2feade8f tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:10.191129 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-1c782081-2fbc-4571-840b-924f2feade8f tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:10.192615 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-1c782081-2fbc-4571-840b-924f2feade8f tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:10.193920 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-1c782081-2fbc-4571-840b-924f2feade8f tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e" status: 200 len: 1720 microversion: 2.20 time: 0.172846 Jun 30 12:40:10.194777 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 375/761] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:40:10 2022] GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e => generated 1720 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:40:11.212760 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-f71899c1-40d0-4452-8f8f-30c2409182a7 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:40:11.213323 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-f71899c1-40d0-4452-8f8f-30c2409182a7 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: 8d6c9ce4-3de7-47d1-8e5a-1abe9091129e] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:40:11.220842 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-f71899c1-40d0-4452-8f8f-30c2409182a7 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:11.221289 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-f71899c1-40d0-4452-8f8f-30c2409182a7 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:11.222057 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-f71899c1-40d0-4452-8f8f-30c2409182a7 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:11.222518 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-f71899c1-40d0-4452-8f8f-30c2409182a7 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:11.362692 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-f71899c1-40d0-4452-8f8f-30c2409182a7 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:11.374348 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-f71899c1-40d0-4452-8f8f-30c2409182a7 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:11.376685 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-f71899c1-40d0-4452-8f8f-30c2409182a7 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:11.378549 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-f71899c1-40d0-4452-8f8f-30c2409182a7 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e" status: 200 len: 1720 microversion: 2.20 time: 0.169611 Jun 30 12:40:11.379389 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 387/762] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:40:11 2022] GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e => generated 1720 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:40:12.398024 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-9e4d6c81-d9db-4120-9c50-69bce5ce34d0 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:40:12.398627 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-9e4d6c81-d9db-4120-9c50-69bce5ce34d0 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: 8d6c9ce4-3de7-47d1-8e5a-1abe9091129e] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:40:12.406287 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-9e4d6c81-d9db-4120-9c50-69bce5ce34d0 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:12.406738 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-9e4d6c81-d9db-4120-9c50-69bce5ce34d0 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:12.407507 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-9e4d6c81-d9db-4120-9c50-69bce5ce34d0 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:12.407926 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-9e4d6c81-d9db-4120-9c50-69bce5ce34d0 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:12.551497 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-9e4d6c81-d9db-4120-9c50-69bce5ce34d0 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:12.561492 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-9e4d6c81-d9db-4120-9c50-69bce5ce34d0 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:12.563856 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-9e4d6c81-d9db-4120-9c50-69bce5ce34d0 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:12.565054 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-9e4d6c81-d9db-4120-9c50-69bce5ce34d0 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e" status: 200 len: 1723 microversion: 2.20 time: 0.170992 Jun 30 12:40:12.565602 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 376/763] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:40:12 2022] GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:40:12.590862 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-ce61e72a-4613-437b-848c-4a9a6802d01e tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "48b3b847-538f-4331-90a2-eac9a04c793f"}} {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:40:12.592118 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-ce61e72a-4613-437b-848c-4a9a6802d01e tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: 8d6c9ce4-3de7-47d1-8e5a-1abe9091129e] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:40:12.599361 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-ce61e72a-4613-437b-848c-4a9a6802d01e tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:12.599805 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-ce61e72a-4613-437b-848c-4a9a6802d01e tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:12.600564 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-ce61e72a-4613-437b-848c-4a9a6802d01e tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:12.601023 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-ce61e72a-4613-437b-848c-4a9a6802d01e tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:12.910422 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-ce61e72a-4613-437b-848c-4a9a6802d01e tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "POST /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.323477 Jun 30 12:40:12.911157 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 388/764] 10.222.0.57 () {62 vars in 1363 bytes} [Thu Jun 30 12:40:12 2022] POST /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e/os-volume_attachments => generated 188 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 12:40:12.962645 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [req-18f6cd75-bf56-461f-9b83-770031b412ef req-ed81f252-2a8b-456b-9b5d-81b974951c69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d6c9ce4-3de7-47d1-8e5a-1abe9091129e", "name": "network-vif-unplugged", "status": "completed", "tag": "f52ef586-26d4-4590-b973-a09504ba1350"}]} {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:40:12.974202 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [req-18f6cd75-bf56-461f-9b83-770031b412ef req-ed81f252-2a8b-456b-9b5d-81b974951c69 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:12.974742 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [req-18f6cd75-bf56-461f-9b83-770031b412ef req-ed81f252-2a8b-456b-9b5d-81b974951c69 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:12.990096 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.compute.server_external_events [req-18f6cd75-bf56-461f-9b83-770031b412ef req-ed81f252-2a8b-456b-9b5d-81b974951c69 service nova] Unable to find a host for instance 8d6c9ce4-3de7-47d1-8e5a-1abe9091129e. Dropping event network-vif-unplugged {{(pid=124298) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 30 12:40:12.991688 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [req-18f6cd75-bf56-461f-9b83-770031b412ef req-ed81f252-2a8b-456b-9b5d-81b974951c69 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.033594 Jun 30 12:40:12.991872 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 377/765] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 30 12:40:12 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 35 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 30 12:40:13.030707 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-31c52b73-8b17-4e7c-84de-2f40471b3bd6 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:40:13.031351 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-31c52b73-8b17-4e7c-84de-2f40471b3bd6 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: 8d6c9ce4-3de7-47d1-8e5a-1abe9091129e] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:40:13.038134 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-31c52b73-8b17-4e7c-84de-2f40471b3bd6 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:13.038697 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-31c52b73-8b17-4e7c-84de-2f40471b3bd6 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:13.039471 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-31c52b73-8b17-4e7c-84de-2f40471b3bd6 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:13.039903 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-31c52b73-8b17-4e7c-84de-2f40471b3bd6 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:13.119005 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-31c52b73-8b17-4e7c-84de-2f40471b3bd6 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "POST /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e/action" status: 202 len: 0 microversion: 2.20 time: 0.093385 Jun 30 12:40:13.119614 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 389/766] 10.222.0.57 () {62 vars in 1318 bytes} [Thu Jun 30 12:40:13 2022] POST /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 30 12:40:13.128265 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-7282a785-9a65-460d-aa14-74fd092809fd tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:40:13.128902 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-7282a785-9a65-460d-aa14-74fd092809fd tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: 8d6c9ce4-3de7-47d1-8e5a-1abe9091129e] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:40:13.135219 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-7282a785-9a65-460d-aa14-74fd092809fd tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:13.135643 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-7282a785-9a65-460d-aa14-74fd092809fd tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:13.136462 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-7282a785-9a65-460d-aa14-74fd092809fd tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:13.137076 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-7282a785-9a65-460d-aa14-74fd092809fd tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:13.276613 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-7282a785-9a65-460d-aa14-74fd092809fd tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:13.286346 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-7282a785-9a65-460d-aa14-74fd092809fd tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:13.288332 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-7282a785-9a65-460d-aa14-74fd092809fd tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:13.289532 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-7282a785-9a65-460d-aa14-74fd092809fd tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e" status: 200 len: 1749 microversion: 2.20 time: 0.165189 Jun 30 12:40:13.290091 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 378/767] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:40:13 2022] GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e => generated 1749 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:40:14.308980 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-256051b4-d312-4952-960d-479b6877e34b tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:40:14.309476 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-256051b4-d312-4952-960d-479b6877e34b tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: 8d6c9ce4-3de7-47d1-8e5a-1abe9091129e] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:40:14.316104 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-256051b4-d312-4952-960d-479b6877e34b tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:14.316555 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-256051b4-d312-4952-960d-479b6877e34b tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:14.317346 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-256051b4-d312-4952-960d-479b6877e34b tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:14.317782 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-256051b4-d312-4952-960d-479b6877e34b tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:14.463812 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-256051b4-d312-4952-960d-479b6877e34b tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:14.466037 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG dbcounter [-] [124297] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=124297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:40:14.473784 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-256051b4-d312-4952-960d-479b6877e34b tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:14.475267 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-256051b4-d312-4952-960d-479b6877e34b tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:14.476556 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-256051b4-d312-4952-960d-479b6877e34b tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e" status: 200 len: 1751 microversion: 2.20 time: 0.172153 Jun 30 12:40:14.477152 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 390/768] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:40:14 2022] GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e => generated 1751 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:40:15.496146 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-904fbbae-27e6-416a-83ce-528bc8cb4571 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:40:15.496978 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-904fbbae-27e6-416a-83ce-528bc8cb4571 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: 8d6c9ce4-3de7-47d1-8e5a-1abe9091129e] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:40:15.504904 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-904fbbae-27e6-416a-83ce-528bc8cb4571 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:15.505302 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-904fbbae-27e6-416a-83ce-528bc8cb4571 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:15.506099 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-904fbbae-27e6-416a-83ce-528bc8cb4571 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:15.506526 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-904fbbae-27e6-416a-83ce-528bc8cb4571 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:15.648671 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-904fbbae-27e6-416a-83ce-528bc8cb4571 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:15.658314 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-904fbbae-27e6-416a-83ce-528bc8cb4571 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:15.659793 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-904fbbae-27e6-416a-83ce-528bc8cb4571 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:15.660958 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-904fbbae-27e6-416a-83ce-528bc8cb4571 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e" status: 200 len: 1807 microversion: 2.20 time: 0.168755 Jun 30 12:40:15.661518 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 379/769] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:40:15 2022] GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:40:16.679883 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-6d81c6ef-df31-402d-95c7-4495e3a92949 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:40:16.680430 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-6d81c6ef-df31-402d-95c7-4495e3a92949 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: 8d6c9ce4-3de7-47d1-8e5a-1abe9091129e] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:40:16.688324 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-6d81c6ef-df31-402d-95c7-4495e3a92949 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:16.688803 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-6d81c6ef-df31-402d-95c7-4495e3a92949 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:16.689575 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-6d81c6ef-df31-402d-95c7-4495e3a92949 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:16.690009 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-6d81c6ef-df31-402d-95c7-4495e3a92949 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:16.847148 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-6d81c6ef-df31-402d-95c7-4495e3a92949 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:16.855988 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-6d81c6ef-df31-402d-95c7-4495e3a92949 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:16.857528 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-6d81c6ef-df31-402d-95c7-4495e3a92949 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:16.858700 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-6d81c6ef-df31-402d-95c7-4495e3a92949 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e" status: 200 len: 1807 microversion: 2.20 time: 0.182872 Jun 30 12:40:16.859792 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 391/770] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:40:16 2022] GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e => generated 1807 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:40:17.878636 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-66fdd91b-95a4-4813-830f-b1ef0220c75d tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:40:17.879239 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-66fdd91b-95a4-4813-830f-b1ef0220c75d tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: 8d6c9ce4-3de7-47d1-8e5a-1abe9091129e] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:40:17.885988 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-66fdd91b-95a4-4813-830f-b1ef0220c75d tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:17.886464 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-66fdd91b-95a4-4813-830f-b1ef0220c75d tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:17.887226 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-66fdd91b-95a4-4813-830f-b1ef0220c75d tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:17.887671 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-66fdd91b-95a4-4813-830f-b1ef0220c75d tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:18.039550 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-66fdd91b-95a4-4813-830f-b1ef0220c75d tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:18.048534 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-66fdd91b-95a4-4813-830f-b1ef0220c75d tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:18.050063 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-66fdd91b-95a4-4813-830f-b1ef0220c75d tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:18.051409 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-66fdd91b-95a4-4813-830f-b1ef0220c75d tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e" status: 200 len: 1807 microversion: 2.20 time: 0.176826 Jun 30 12:40:18.053125 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 380/771] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:40:17 2022] GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e => generated 1807 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:40:19.070593 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-22a5eed3-aa7f-4c36-9edf-7cfe8c218954 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:40:19.071175 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-22a5eed3-aa7f-4c36-9edf-7cfe8c218954 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: 8d6c9ce4-3de7-47d1-8e5a-1abe9091129e] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:40:19.079629 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-22a5eed3-aa7f-4c36-9edf-7cfe8c218954 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:19.080107 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-22a5eed3-aa7f-4c36-9edf-7cfe8c218954 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:19.080917 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-22a5eed3-aa7f-4c36-9edf-7cfe8c218954 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:19.081363 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-22a5eed3-aa7f-4c36-9edf-7cfe8c218954 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:19.233343 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-22a5eed3-aa7f-4c36-9edf-7cfe8c218954 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:19.242077 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-22a5eed3-aa7f-4c36-9edf-7cfe8c218954 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:19.243553 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-22a5eed3-aa7f-4c36-9edf-7cfe8c218954 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:19.244740 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-22a5eed3-aa7f-4c36-9edf-7cfe8c218954 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e" status: 200 len: 1807 microversion: 2.20 time: 0.178099 Jun 30 12:40:19.245307 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 392/772] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:40:19 2022] GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e => generated 1807 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:40:20.263947 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-6c4da2d2-1afb-4443-987d-72e48d16a934 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:40:20.264858 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-6c4da2d2-1afb-4443-987d-72e48d16a934 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: 8d6c9ce4-3de7-47d1-8e5a-1abe9091129e] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:40:20.272772 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-6c4da2d2-1afb-4443-987d-72e48d16a934 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:20.273219 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-6c4da2d2-1afb-4443-987d-72e48d16a934 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:20.273999 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-6c4da2d2-1afb-4443-987d-72e48d16a934 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:20.274427 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-6c4da2d2-1afb-4443-987d-72e48d16a934 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:20.417904 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-6c4da2d2-1afb-4443-987d-72e48d16a934 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:20.427568 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-6c4da2d2-1afb-4443-987d-72e48d16a934 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:20.429288 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-6c4da2d2-1afb-4443-987d-72e48d16a934 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:20.430408 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-6c4da2d2-1afb-4443-987d-72e48d16a934 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e" status: 200 len: 1807 microversion: 2.20 time: 0.170926 Jun 30 12:40:20.431202 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 381/773] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:40:20 2022] GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:40:21.450994 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-ec6f2cc2-e1ae-427b-abc3-7c6a572cc0ee tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:40:21.450994 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-ec6f2cc2-e1ae-427b-abc3-7c6a572cc0ee tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: 8d6c9ce4-3de7-47d1-8e5a-1abe9091129e] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:40:21.457080 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-ec6f2cc2-e1ae-427b-abc3-7c6a572cc0ee tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:21.457544 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-ec6f2cc2-e1ae-427b-abc3-7c6a572cc0ee tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:21.458318 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-ec6f2cc2-e1ae-427b-abc3-7c6a572cc0ee tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:21.458742 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-ec6f2cc2-e1ae-427b-abc3-7c6a572cc0ee tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:21.600568 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-ec6f2cc2-e1ae-427b-abc3-7c6a572cc0ee tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:21.616679 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-ec6f2cc2-e1ae-427b-abc3-7c6a572cc0ee tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:21.618204 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-ec6f2cc2-e1ae-427b-abc3-7c6a572cc0ee tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:21.619389 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-ec6f2cc2-e1ae-427b-abc3-7c6a572cc0ee tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e" status: 200 len: 1807 microversion: 2.20 time: 0.174214 Jun 30 12:40:21.620159 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 393/774] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:40:21 2022] GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e => generated 1807 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:40:22.637989 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-abd4ba23-b81f-4193-82d7-c76fce105ebd tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:40:22.638703 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-abd4ba23-b81f-4193-82d7-c76fce105ebd tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: 8d6c9ce4-3de7-47d1-8e5a-1abe9091129e] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:40:22.645871 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-abd4ba23-b81f-4193-82d7-c76fce105ebd tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:22.646316 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-abd4ba23-b81f-4193-82d7-c76fce105ebd tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:22.647091 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-abd4ba23-b81f-4193-82d7-c76fce105ebd tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:22.647529 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-abd4ba23-b81f-4193-82d7-c76fce105ebd tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:22.788983 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-abd4ba23-b81f-4193-82d7-c76fce105ebd tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:22.797793 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-abd4ba23-b81f-4193-82d7-c76fce105ebd tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:22.799360 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-abd4ba23-b81f-4193-82d7-c76fce105ebd tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:22.800651 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-abd4ba23-b81f-4193-82d7-c76fce105ebd tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e" status: 200 len: 1807 microversion: 2.20 time: 0.166783 Jun 30 12:40:22.801302 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 382/775] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:40:22 2022] GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:40:23.819898 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-bd0cf0c1-b091-4f19-97d5-bd3c1ca4a4cb tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:40:23.820505 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-bd0cf0c1-b091-4f19-97d5-bd3c1ca4a4cb tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: 8d6c9ce4-3de7-47d1-8e5a-1abe9091129e] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:40:23.827544 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-bd0cf0c1-b091-4f19-97d5-bd3c1ca4a4cb tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:23.828055 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-bd0cf0c1-b091-4f19-97d5-bd3c1ca4a4cb tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:23.828939 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-bd0cf0c1-b091-4f19-97d5-bd3c1ca4a4cb tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:23.829498 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-bd0cf0c1-b091-4f19-97d5-bd3c1ca4a4cb tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:23.972510 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-bd0cf0c1-b091-4f19-97d5-bd3c1ca4a4cb tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:23.982747 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-bd0cf0c1-b091-4f19-97d5-bd3c1ca4a4cb tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:23.984258 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-bd0cf0c1-b091-4f19-97d5-bd3c1ca4a4cb tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:23.985515 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-bd0cf0c1-b091-4f19-97d5-bd3c1ca4a4cb tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e" status: 200 len: 1807 microversion: 2.20 time: 0.169927 Jun 30 12:40:23.986070 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 394/776] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:40:23 2022] GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:40:25.007956 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-eed65884-bf14-415a-b3f3-aedb9d671c0e tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:40:25.008981 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-eed65884-bf14-415a-b3f3-aedb9d671c0e tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: 8d6c9ce4-3de7-47d1-8e5a-1abe9091129e] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:40:25.018860 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-eed65884-bf14-415a-b3f3-aedb9d671c0e tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:25.019311 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-eed65884-bf14-415a-b3f3-aedb9d671c0e tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:25.020108 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-eed65884-bf14-415a-b3f3-aedb9d671c0e tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:25.020543 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-eed65884-bf14-415a-b3f3-aedb9d671c0e tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:25.161875 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-eed65884-bf14-415a-b3f3-aedb9d671c0e tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:25.171438 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-eed65884-bf14-415a-b3f3-aedb9d671c0e tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:25.173041 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-eed65884-bf14-415a-b3f3-aedb9d671c0e tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:25.174146 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-eed65884-bf14-415a-b3f3-aedb9d671c0e tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e" status: 200 len: 1807 microversion: 2.20 time: 0.172763 Jun 30 12:40:25.174708 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 383/777] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:40:24 2022] GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e => generated 1807 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:40:26.191699 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-163ad97b-9694-4292-9a7e-eec70c06e23d tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:40:26.192286 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-163ad97b-9694-4292-9a7e-eec70c06e23d tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: 8d6c9ce4-3de7-47d1-8e5a-1abe9091129e] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:40:26.198922 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-163ad97b-9694-4292-9a7e-eec70c06e23d tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:26.199365 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-163ad97b-9694-4292-9a7e-eec70c06e23d tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:26.200123 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-163ad97b-9694-4292-9a7e-eec70c06e23d tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:26.200548 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-163ad97b-9694-4292-9a7e-eec70c06e23d tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:26.335000 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-163ad97b-9694-4292-9a7e-eec70c06e23d tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:26.343857 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-163ad97b-9694-4292-9a7e-eec70c06e23d tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:26.345571 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-163ad97b-9694-4292-9a7e-eec70c06e23d tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:26.346737 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-163ad97b-9694-4292-9a7e-eec70c06e23d tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e" status: 200 len: 1807 microversion: 2.20 time: 0.159161 Jun 30 12:40:26.347292 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 395/778] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:40:26 2022] GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:40:27.369914 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-752ff87a-1dad-4200-9a21-18253e040b2a tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:40:27.370876 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-752ff87a-1dad-4200-9a21-18253e040b2a tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: 8d6c9ce4-3de7-47d1-8e5a-1abe9091129e] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:40:27.379851 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-752ff87a-1dad-4200-9a21-18253e040b2a tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:27.380307 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-752ff87a-1dad-4200-9a21-18253e040b2a tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:27.381110 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-752ff87a-1dad-4200-9a21-18253e040b2a tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:27.381545 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-752ff87a-1dad-4200-9a21-18253e040b2a tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:27.522618 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-752ff87a-1dad-4200-9a21-18253e040b2a tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:27.531779 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-752ff87a-1dad-4200-9a21-18253e040b2a tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:27.533392 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-752ff87a-1dad-4200-9a21-18253e040b2a tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:27.534550 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-752ff87a-1dad-4200-9a21-18253e040b2a tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e" status: 200 len: 1807 microversion: 2.20 time: 0.171416 Jun 30 12:40:27.535104 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 384/779] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:40:27 2022] GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:40:28.553484 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-225d1efc-0d73-4ef6-b335-5e6c500ce26c tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:40:28.554103 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-225d1efc-0d73-4ef6-b335-5e6c500ce26c tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: 8d6c9ce4-3de7-47d1-8e5a-1abe9091129e] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:40:28.561159 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-225d1efc-0d73-4ef6-b335-5e6c500ce26c tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:28.561598 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-225d1efc-0d73-4ef6-b335-5e6c500ce26c tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:28.562355 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-225d1efc-0d73-4ef6-b335-5e6c500ce26c tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:28.562783 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-225d1efc-0d73-4ef6-b335-5e6c500ce26c tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:28.699372 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-225d1efc-0d73-4ef6-b335-5e6c500ce26c tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:28.708203 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-225d1efc-0d73-4ef6-b335-5e6c500ce26c tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:28.709725 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-225d1efc-0d73-4ef6-b335-5e6c500ce26c tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:28.710889 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-225d1efc-0d73-4ef6-b335-5e6c500ce26c tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e" status: 200 len: 1807 microversion: 2.20 time: 0.161466 Jun 30 12:40:28.711459 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 396/780] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:40:28 2022] GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:40:29.729867 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-cc37859e-7025-4caf-a905-029fa59bec78 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:40:29.730474 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-cc37859e-7025-4caf-a905-029fa59bec78 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: 8d6c9ce4-3de7-47d1-8e5a-1abe9091129e] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:40:29.737386 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-cc37859e-7025-4caf-a905-029fa59bec78 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:29.737830 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-cc37859e-7025-4caf-a905-029fa59bec78 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:29.738588 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-cc37859e-7025-4caf-a905-029fa59bec78 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:29.739019 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-cc37859e-7025-4caf-a905-029fa59bec78 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:29.890524 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-cc37859e-7025-4caf-a905-029fa59bec78 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:29.899448 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-cc37859e-7025-4caf-a905-029fa59bec78 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:29.900965 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-cc37859e-7025-4caf-a905-029fa59bec78 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:29.902127 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-cc37859e-7025-4caf-a905-029fa59bec78 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e" status: 200 len: 1807 microversion: 2.20 time: 0.176381 Jun 30 12:40:29.902689 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 385/781] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:40:29 2022] GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e => generated 1807 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:40:30.922586 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-e042f5cd-dc63-4b9d-a5a2-afc253678d07 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:40:30.923308 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-e042f5cd-dc63-4b9d-a5a2-afc253678d07 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: 8d6c9ce4-3de7-47d1-8e5a-1abe9091129e] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:40:30.931141 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-e042f5cd-dc63-4b9d-a5a2-afc253678d07 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:30.931581 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-e042f5cd-dc63-4b9d-a5a2-afc253678d07 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:30.932344 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-e042f5cd-dc63-4b9d-a5a2-afc253678d07 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:30.933219 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-e042f5cd-dc63-4b9d-a5a2-afc253678d07 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:31.063568 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-e042f5cd-dc63-4b9d-a5a2-afc253678d07 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:31.072479 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-e042f5cd-dc63-4b9d-a5a2-afc253678d07 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:31.074052 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-e042f5cd-dc63-4b9d-a5a2-afc253678d07 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:31.075211 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-e042f5cd-dc63-4b9d-a5a2-afc253678d07 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e" status: 200 len: 1807 microversion: 2.20 time: 0.157840 Jun 30 12:40:31.075771 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 397/782] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:40:30 2022] GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:40:32.097846 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-04271a1e-f4cb-410e-a58a-ce6ca89215e7 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:40:32.098676 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-04271a1e-f4cb-410e-a58a-ce6ca89215e7 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: 8d6c9ce4-3de7-47d1-8e5a-1abe9091129e] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:40:32.107051 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-04271a1e-f4cb-410e-a58a-ce6ca89215e7 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:32.107600 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-04271a1e-f4cb-410e-a58a-ce6ca89215e7 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:32.108537 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-04271a1e-f4cb-410e-a58a-ce6ca89215e7 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:32.109113 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-04271a1e-f4cb-410e-a58a-ce6ca89215e7 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:32.112947 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG dbcounter [-] [124298] Writing DB stats nova_cell1:SELECT=93 {{(pid=124298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:40:32.529504 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-04271a1e-f4cb-410e-a58a-ce6ca89215e7 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:32.539227 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-04271a1e-f4cb-410e-a58a-ce6ca89215e7 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:32.540731 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-04271a1e-f4cb-410e-a58a-ce6ca89215e7 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:32.541917 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-04271a1e-f4cb-410e-a58a-ce6ca89215e7 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e" status: 200 len: 1807 microversion: 2.20 time: 0.450785 Jun 30 12:40:32.542472 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 386/783] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:40:32 2022] GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e => generated 1807 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:40:33.119254 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [req-27bd9dd4-d877-4cf6-9a20-a9a38fe71b7c req-051e5507-c1d7-4801-8b57-f91b6d299e6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d6c9ce4-3de7-47d1-8e5a-1abe9091129e", "name": "network-vif-plugged", "status": "completed", "tag": "f52ef586-26d4-4590-b973-a09504ba1350"}]} {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:40:33.128926 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [req-27bd9dd4-d877-4cf6-9a20-a9a38fe71b7c req-051e5507-c1d7-4801-8b57-f91b6d299e6b service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:33.129303 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [req-27bd9dd4-d877-4cf6-9a20-a9a38fe71b7c req-051e5507-c1d7-4801-8b57-f91b6d299e6b service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:33.140754 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.compute.server_external_events [req-27bd9dd4-d877-4cf6-9a20-a9a38fe71b7c req-051e5507-c1d7-4801-8b57-f91b6d299e6b service nova] Creating event network-vif-plugged:f52ef586-26d4-4590-b973-a09504ba1350 for instance 8d6c9ce4-3de7-47d1-8e5a-1abe9091129e on hv-cinder-84614 Jun 30 12:40:33.146379 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [req-27bd9dd4-d877-4cf6-9a20-a9a38fe71b7c req-051e5507-c1d7-4801-8b57-f91b6d299e6b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030865 Jun 30 12:40:33.146988 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 398/784] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 30 12:40:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:40:33.559597 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-661602ac-d677-4b4f-afda-b4863fb254f1 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:40:33.560249 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-661602ac-d677-4b4f-afda-b4863fb254f1 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: 8d6c9ce4-3de7-47d1-8e5a-1abe9091129e] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:40:33.567627 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-661602ac-d677-4b4f-afda-b4863fb254f1 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:33.568069 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-661602ac-d677-4b4f-afda-b4863fb254f1 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:33.568884 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-661602ac-d677-4b4f-afda-b4863fb254f1 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:33.569317 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-661602ac-d677-4b4f-afda-b4863fb254f1 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:33.700356 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-661602ac-d677-4b4f-afda-b4863fb254f1 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:33.708954 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-661602ac-d677-4b4f-afda-b4863fb254f1 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:33.710490 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-661602ac-d677-4b4f-afda-b4863fb254f1 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:33.711651 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-661602ac-d677-4b4f-afda-b4863fb254f1 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e" status: 200 len: 1807 microversion: 2.20 time: 0.156030 Jun 30 12:40:33.712242 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 387/785] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:40:33 2022] GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:40:34.734485 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-1dcaba8f-a9ac-4af5-9248-a340627f93e3 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:40:34.735169 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-1dcaba8f-a9ac-4af5-9248-a340627f93e3 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: 8d6c9ce4-3de7-47d1-8e5a-1abe9091129e] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:40:34.742282 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-1dcaba8f-a9ac-4af5-9248-a340627f93e3 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:34.742724 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-1dcaba8f-a9ac-4af5-9248-a340627f93e3 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:34.743495 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-1dcaba8f-a9ac-4af5-9248-a340627f93e3 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:34.743920 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-1dcaba8f-a9ac-4af5-9248-a340627f93e3 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:34.884694 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-1dcaba8f-a9ac-4af5-9248-a340627f93e3 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:34.893703 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-1dcaba8f-a9ac-4af5-9248-a340627f93e3 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:34.895221 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-1dcaba8f-a9ac-4af5-9248-a340627f93e3 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:34.896388 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-1dcaba8f-a9ac-4af5-9248-a340627f93e3 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e" status: 200 len: 1807 microversion: 2.20 time: 0.169319 Jun 30 12:40:34.897010 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 399/786] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:40:34 2022] GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:40:35.919608 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-40b5aa14-3c38-454f-9c71-503b96a90dd2 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:40:35.920610 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-40b5aa14-3c38-454f-9c71-503b96a90dd2 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: 8d6c9ce4-3de7-47d1-8e5a-1abe9091129e] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:40:35.929015 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-40b5aa14-3c38-454f-9c71-503b96a90dd2 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:35.929472 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-40b5aa14-3c38-454f-9c71-503b96a90dd2 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:35.930239 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-40b5aa14-3c38-454f-9c71-503b96a90dd2 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:35.930673 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-40b5aa14-3c38-454f-9c71-503b96a90dd2 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:36.064833 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-40b5aa14-3c38-454f-9c71-503b96a90dd2 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:36.078181 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-40b5aa14-3c38-454f-9c71-503b96a90dd2 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:36.081395 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-40b5aa14-3c38-454f-9c71-503b96a90dd2 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:36.082693 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-40b5aa14-3c38-454f-9c71-503b96a90dd2 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e" status: 200 len: 1794 microversion: 2.20 time: 0.169661 Jun 30 12:40:36.083340 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 388/787] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:40:35 2022] GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e => generated 1794 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:40:39.193950 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-88081003-0e2e-46bc-a062-085d101882bd tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:40:39.194494 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-88081003-0e2e-46bc-a062-085d101882bd tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: 2a572f38-474c-4395-a917-074c331a5cb7] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:40:39.196952 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG dbcounter [-] [124297] Writing DB stats nova_api:SELECT=30 {{(pid=124297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:40:39.202703 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-88081003-0e2e-46bc-a062-085d101882bd tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:39.203145 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-88081003-0e2e-46bc-a062-085d101882bd tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:39.203912 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-88081003-0e2e-46bc-a062-085d101882bd tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:39.204343 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-88081003-0e2e-46bc-a062-085d101882bd tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:39.228160 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-88081003-0e2e-46bc-a062-085d101882bd tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "GET /compute/v2.1/servers/2a572f38-474c-4395-a917-074c331a5cb7/ips" status: 200 len: 148 microversion: 2.1 time: 0.038612 Jun 30 12:40:39.228923 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 400/788] 10.222.0.57 () {58 vars in 1247 bytes} [Thu Jun 30 12:40:39 2022] GET /compute/v2.1/servers/2a572f38-474c-4395-a917-074c331a5cb7/ips => generated 148 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:40:40.608136 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-d44e09cb-57c4-4e73-8743-d532730554d8 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "13da325f-2319-41c4-b7d3-15a42f5ce34b"}} {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:40:40.609302 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-d44e09cb-57c4-4e73-8743-d532730554d8 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: 2a572f38-474c-4395-a917-074c331a5cb7] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:40:40.611725 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG dbcounter [-] [124298] Writing DB stats nova_api:SELECT=28 {{(pid=124298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:40:40.617806 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-d44e09cb-57c4-4e73-8743-d532730554d8 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:40.618248 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-d44e09cb-57c4-4e73-8743-d532730554d8 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:40.619011 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-d44e09cb-57c4-4e73-8743-d532730554d8 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:40.619442 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-d44e09cb-57c4-4e73-8743-d532730554d8 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:40.897042 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-d44e09cb-57c4-4e73-8743-d532730554d8 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "POST /compute/v2.1/servers/2a572f38-474c-4395-a917-074c331a5cb7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.292859 Jun 30 12:40:40.897754 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 389/789] 10.222.0.57 () {60 vars in 1322 bytes} [Thu Jun 30 12:40:40 2022] POST /compute/v2.1/servers/2a572f38-474c-4395-a917-074c331a5cb7/os-volume_attachments => generated 194 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:40:48.489630 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-e76449b7-4ac9-4f5e-9897-7a573f2556ca tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Action: 'create', calling method: .version_select at 0x7fd0dafae0d0>, body: {"keypair": {"name": "tempest-keypair-1199944920", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPqpCQ2sLdO5fhQH6dW6LpMLFbhGqeqe8z9aSKvKfeTTBMu8SQO3henQIxrIR/dINzzzcQBKqVx2wyQuOq99uJDxmmK8NZhGnSmUhqSkSVuEWPLxUUg+74HS/X9G1UyUbg=="}} {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:40:48.505810 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.quota [None req-e76449b7-4ac9-4f5e-9897-7a573f2556ca tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Getting quotas for project 359201313a944a8fa9881ee6fdea67e2. Resources: {'key_pairs'} {{(pid=124297) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 12:40:48.512646 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.quota [None req-e76449b7-4ac9-4f5e-9897-7a573f2556ca tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Getting quotas for user e935f2637d124453947b3c78360567a5 and project 359201313a944a8fa9881ee6fdea67e2. Resources: {'key_pairs'} {{(pid=124297) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 12:40:48.544083 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-e76449b7-4ac9-4f5e-9897-7a573f2556ca tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.058312 Jun 30 12:40:48.544736 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 401/790] 10.222.0.57 () {60 vars in 1158 bytes} [Thu Jun 30 12:40:48 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:40:49.829299 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-36a5ed79-ab13-46d8-83c4-d0e5fb8de881 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2123098903", "imageRef": "776a1662-a241-4e20-9a9c-e4743c64efd0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0cf7ba00-1ef8-492b-b4f6-ee883e3dfe65"}], "security_groups": [{"name": "tempest-securitygroup--929116491"}], "key_name": "tempest-keypair-1199944920", "user_data": "}} {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:40:49.939238 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.network.neutron [None req-36a5ed79-ab13-46d8-83c4-d0e5fb8de881 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] validate_networks() for [('0cf7ba00-1ef8-492b-b4f6-ee883e3dfe65', None, None, None, None, None)] {{(pid=124298) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 12:40:50.341481 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.virt.hardware [None req-36a5ed79-ab13-46d8-83c4-d0e5fb8de881 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Flavor limits 0:0:0 {{(pid=124298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 12:40:50.342096 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.virt.hardware [None req-36a5ed79-ab13-46d8-83c4-d0e5fb8de881 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Image limits 0:0:0 {{(pid=124298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 12:40:50.342772 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.virt.hardware [None req-36a5ed79-ab13-46d8-83c4-d0e5fb8de881 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Flavor pref 0:0:0 {{(pid=124298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 12:40:50.343351 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.virt.hardware [None req-36a5ed79-ab13-46d8-83c4-d0e5fb8de881 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Image pref 0:0:0 {{(pid=124298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 12:40:50.343919 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.virt.hardware [None req-36a5ed79-ab13-46d8-83c4-d0e5fb8de881 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 12:40:50.356379 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-36a5ed79-ab13-46d8-83c4-d0e5fb8de881 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:50.356862 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-36a5ed79-ab13-46d8-83c4-d0e5fb8de881 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:50.357662 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-36a5ed79-ab13-46d8-83c4-d0e5fb8de881 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:50.358120 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-36a5ed79-ab13-46d8-83c4-d0e5fb8de881 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:50.374822 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.quota [None req-36a5ed79-ab13-46d8-83c4-d0e5fb8de881 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Getting quotas for project 359201313a944a8fa9881ee6fdea67e2. Resources: {'cores', 'ram', 'instances'} {{(pid=124298) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 12:40:50.379223 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.quota [None req-36a5ed79-ab13-46d8-83c4-d0e5fb8de881 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Getting quotas for user e935f2637d124453947b3c78360567a5 and project 359201313a944a8fa9881ee6fdea67e2. Resources: {'cores', 'ram', 'instances'} {{(pid=124298) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 12:40:50.391599 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-36a5ed79-ab13-46d8-83c4-d0e5fb8de881 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Going to run 1 instances... {{(pid=124298) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 12:40:50.393957 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-36a5ed79-ab13-46d8-83c4-d0e5fb8de881 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: ba748986-dc18-4e3c-98fd-f3f0a6a46e2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='776a1662-a241-4e20-9a9c-e4743c64efd0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124298) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 12:40:50.447659 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-36a5ed79-ab13-46d8-83c4-d0e5fb8de881 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.623644 Jun 30 12:40:50.448313 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 390/791] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 30 12:40:49 2022] POST /compute/v2.1/servers => generated 401 bytes in 625 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 12:40:50.458104 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG dbcounter [-] [124297] Writing DB stats nova_cell1:SELECT=55 {{(pid=124297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:40:50.462849 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-70dd0a1d-6dee-4fd6-8255-1deac82ed776 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:40:50.463567 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-70dd0a1d-6dee-4fd6-8255-1deac82ed776 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: ba748986-dc18-4e3c-98fd-f3f0a6a46e2e] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:40:50.518156 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-70dd0a1d-6dee-4fd6-8255-1deac82ed776 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e935f2637d124453947b3c78360567a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359201313a944a8fa9881ee6fdea67e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:50.525032 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-70dd0a1d-6dee-4fd6-8255-1deac82ed776 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "GET /compute/v2.1/servers/ba748986-dc18-4e3c-98fd-f3f0a6a46e2e" status: 200 len: 1242 microversion: 2.1 time: 0.067440 Jun 30 12:40:50.525636 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 402/792] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:40:50 2022] GET /compute/v2.1/servers/ba748986-dc18-4e3c-98fd-f3f0a6a46e2e => generated 1242 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:40:51.543327 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-93182fc8-a20b-4ef2-8faf-328413d02a65 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:40:51.545077 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-93182fc8-a20b-4ef2-8faf-328413d02a65 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: ba748986-dc18-4e3c-98fd-f3f0a6a46e2e] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:40:51.554220 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-93182fc8-a20b-4ef2-8faf-328413d02a65 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:51.555871 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-93182fc8-a20b-4ef2-8faf-328413d02a65 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:51.556937 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-93182fc8-a20b-4ef2-8faf-328413d02a65 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:51.557782 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-93182fc8-a20b-4ef2-8faf-328413d02a65 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:51.648849 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-93182fc8-a20b-4ef2-8faf-328413d02a65 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e935f2637d124453947b3c78360567a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359201313a944a8fa9881ee6fdea67e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:51.655652 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-5f26afb0-9187-48aa-805b-0bacb6ef258d tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:40:51.656151 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-5f26afb0-9187-48aa-805b-0bacb6ef258d tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] [instance: 17ef4273-4c60-498a-9061-2c4fbedbafdb] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:40:51.659971 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-93182fc8-a20b-4ef2-8faf-328413d02a65 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "GET /compute/v2.1/servers/ba748986-dc18-4e3c-98fd-f3f0a6a46e2e" status: 200 len: 1294 microversion: 2.1 time: 0.121318 Jun 30 12:40:51.661504 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 391/793] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:40:51 2022] GET /compute/v2.1/servers/ba748986-dc18-4e3c-98fd-f3f0a6a46e2e => generated 1294 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:40:51.667526 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [req-bdc5e21c-f4c3-4db7-9bda-adf24c3a9f8a req-860ade98-3b04-4171-b3c0-1033f56036ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17ef4273-4c60-498a-9061-2c4fbedbafdb", "tag": "7fb1dbc5-fce3-4c9f-bb9e-b486d232eebc"}]} {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:40:51.674782 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-5f26afb0-9187-48aa-805b-0bacb6ef258d tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:51.675239 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-5f26afb0-9187-48aa-805b-0bacb6ef258d tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:51.676025 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-5f26afb0-9187-48aa-805b-0bacb6ef258d tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:51.676457 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-5f26afb0-9187-48aa-805b-0bacb6ef258d tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:51.680771 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [req-bdc5e21c-f4c3-4db7-9bda-adf24c3a9f8a req-860ade98-3b04-4171-b3c0-1033f56036ad service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:51.681500 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [req-bdc5e21c-f4c3-4db7-9bda-adf24c3a9f8a req-860ade98-3b04-4171-b3c0-1033f56036ad service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:51.700078 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.compute.server_external_events [req-bdc5e21c-f4c3-4db7-9bda-adf24c3a9f8a req-860ade98-3b04-4171-b3c0-1033f56036ad service nova] Creating event network-changed:7fb1dbc5-fce3-4c9f-bb9e-b486d232eebc for instance 17ef4273-4c60-498a-9061-2c4fbedbafdb on hv-cinder-84614 Jun 30 12:40:51.706978 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [req-bdc5e21c-f4c3-4db7-9bda-adf24c3a9f8a req-860ade98-3b04-4171-b3c0-1033f56036ad service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043976 Jun 30 12:40:51.708204 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 392/794] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 30 12:40:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:40:51.737248 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-5f26afb0-9187-48aa-805b-0bacb6ef258d tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] [instance: 17ef4273-4c60-498a-9061-2c4fbedbafdb] Going to try to terminate instance {{(pid=124297) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 12:40:51.863623 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-5f26afb0-9187-48aa-805b-0bacb6ef258d tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] 10.222.0.57 "DELETE /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb" status: 204 len: 0 microversion: 2.1 time: 0.211917 Jun 30 12:40:51.865101 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 403/795] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 30 12:40:51 2022] DELETE /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 12:40:51.876133 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-09b85d4c-4b88-4a1b-9459-8c6abb0ab568 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:40:51.877671 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-09b85d4c-4b88-4a1b-9459-8c6abb0ab568 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] [instance: 17ef4273-4c60-498a-9061-2c4fbedbafdb] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:40:51.885370 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-09b85d4c-4b88-4a1b-9459-8c6abb0ab568 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:51.886587 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-09b85d4c-4b88-4a1b-9459-8c6abb0ab568 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:51.887848 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-09b85d4c-4b88-4a1b-9459-8c6abb0ab568 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:51.888517 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-09b85d4c-4b88-4a1b-9459-8c6abb0ab568 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:52.080033 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-09b85d4c-4b88-4a1b-9459-8c6abb0ab568 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81aa9d47cd1470abef31a27839eaf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8abe616c14a4920b1cbc45733fa5771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:52.088296 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-09b85d4c-4b88-4a1b-9459-8c6abb0ab568 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] 10.222.0.57 "GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb" status: 200 len: 1569 microversion: 2.1 time: 0.218192 Jun 30 12:40:52.088990 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 393/796] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:40:51 2022] GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb => generated 1569 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:40:52.681834 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-9db5f130-70f4-4cf0-bccb-6fe6b65e6bf9 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:40:52.682585 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-9db5f130-70f4-4cf0-bccb-6fe6b65e6bf9 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: ba748986-dc18-4e3c-98fd-f3f0a6a46e2e] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:40:52.689431 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-9db5f130-70f4-4cf0-bccb-6fe6b65e6bf9 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:52.689865 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-9db5f130-70f4-4cf0-bccb-6fe6b65e6bf9 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:52.690673 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-9db5f130-70f4-4cf0-bccb-6fe6b65e6bf9 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:52.691110 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-9db5f130-70f4-4cf0-bccb-6fe6b65e6bf9 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:52.760154 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-9db5f130-70f4-4cf0-bccb-6fe6b65e6bf9 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e935f2637d124453947b3c78360567a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359201313a944a8fa9881ee6fdea67e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:52.768346 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-9db5f130-70f4-4cf0-bccb-6fe6b65e6bf9 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "GET /compute/v2.1/servers/ba748986-dc18-4e3c-98fd-f3f0a6a46e2e" status: 200 len: 1300 microversion: 2.1 time: 0.093710 Jun 30 12:40:52.769008 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 404/797] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:40:52 2022] GET /compute/v2.1/servers/ba748986-dc18-4e3c-98fd-f3f0a6a46e2e => generated 1300 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:40:53.106209 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-7bbc5560-2d8b-40e4-9571-7efa564779f5 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:40:53.106851 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-7bbc5560-2d8b-40e4-9571-7efa564779f5 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] [instance: 17ef4273-4c60-498a-9061-2c4fbedbafdb] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:40:53.113569 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-7bbc5560-2d8b-40e4-9571-7efa564779f5 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:53.114014 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-7bbc5560-2d8b-40e4-9571-7efa564779f5 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:53.114779 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-7bbc5560-2d8b-40e4-9571-7efa564779f5 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:53.115243 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-7bbc5560-2d8b-40e4-9571-7efa564779f5 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:53.287301 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-7bbc5560-2d8b-40e4-9571-7efa564779f5 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81aa9d47cd1470abef31a27839eaf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8abe616c14a4920b1cbc45733fa5771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:53.295304 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-7bbc5560-2d8b-40e4-9571-7efa564779f5 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] 10.222.0.57 "GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb" status: 200 len: 1569 microversion: 2.1 time: 0.193160 Jun 30 12:40:53.295891 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 394/798] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:40:53 2022] GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb => generated 1569 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:40:53.785516 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-5653306d-c69c-4a0e-9553-3db0a7c4b7d7 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:40:53.787056 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-5653306d-c69c-4a0e-9553-3db0a7c4b7d7 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: ba748986-dc18-4e3c-98fd-f3f0a6a46e2e] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:40:53.794400 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-5653306d-c69c-4a0e-9553-3db0a7c4b7d7 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:53.795575 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-5653306d-c69c-4a0e-9553-3db0a7c4b7d7 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:53.796366 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-5653306d-c69c-4a0e-9553-3db0a7c4b7d7 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:53.796833 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-5653306d-c69c-4a0e-9553-3db0a7c4b7d7 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:54.033163 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-5653306d-c69c-4a0e-9553-3db0a7c4b7d7 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e935f2637d124453947b3c78360567a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359201313a944a8fa9881ee6fdea67e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:54.043257 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-5653306d-c69c-4a0e-9553-3db0a7c4b7d7 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "GET /compute/v2.1/servers/ba748986-dc18-4e3c-98fd-f3f0a6a46e2e" status: 200 len: 1367 microversion: 2.1 time: 0.261739 Jun 30 12:40:54.043866 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 405/799] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:40:53 2022] GET /compute/v2.1/servers/ba748986-dc18-4e3c-98fd-f3f0a6a46e2e => generated 1367 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:40:54.312700 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-74b90f6f-3d21-48ff-b729-ca6f2aae5953 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:40:54.313511 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-74b90f6f-3d21-48ff-b729-ca6f2aae5953 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] [instance: 17ef4273-4c60-498a-9061-2c4fbedbafdb] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:40:54.320249 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-74b90f6f-3d21-48ff-b729-ca6f2aae5953 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:54.320734 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-74b90f6f-3d21-48ff-b729-ca6f2aae5953 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:54.321510 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-74b90f6f-3d21-48ff-b729-ca6f2aae5953 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:54.322081 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-74b90f6f-3d21-48ff-b729-ca6f2aae5953 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:54.462110 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-74b90f6f-3d21-48ff-b729-ca6f2aae5953 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81aa9d47cd1470abef31a27839eaf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8abe616c14a4920b1cbc45733fa5771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:54.470943 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-74b90f6f-3d21-48ff-b729-ca6f2aae5953 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] 10.222.0.57 "GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb" status: 200 len: 1450 microversion: 2.1 time: 0.162281 Jun 30 12:40:54.471856 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 395/800] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:40:54 2022] GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb => generated 1450 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:40:54.856481 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [req-1c7c613a-6b61-49df-b9a3-7f4d8ae6af50 req-71d7c93f-d704-4490-a6d3-4bf5bd1b1327 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba748986-dc18-4e3c-98fd-f3f0a6a46e2e", "tag": "d9729688-4600-45ad-a9ec-544e2a25a91a"}]} {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:40:54.878797 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [req-1c7c613a-6b61-49df-b9a3-7f4d8ae6af50 req-71d7c93f-d704-4490-a6d3-4bf5bd1b1327 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:54.879425 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [req-1c7c613a-6b61-49df-b9a3-7f4d8ae6af50 req-71d7c93f-d704-4490-a6d3-4bf5bd1b1327 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:54.899157 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.compute.server_external_events [req-1c7c613a-6b61-49df-b9a3-7f4d8ae6af50 req-71d7c93f-d704-4490-a6d3-4bf5bd1b1327 service nova] Creating event network-changed:d9729688-4600-45ad-a9ec-544e2a25a91a for instance ba748986-dc18-4e3c-98fd-f3f0a6a46e2e on hv-cinder-84614 Jun 30 12:40:54.906681 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [req-1c7c613a-6b61-49df-b9a3-7f4d8ae6af50 req-71d7c93f-d704-4490-a6d3-4bf5bd1b1327 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055362 Jun 30 12:40:54.908619 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 406/801] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 30 12:40:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:40:55.019729 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-974bb46a-5f36-494f-a4ec-ba6616c8bf78 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1594922985", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1101131035", "security_groups": [{"name": "tempest-secgroup-smoke-489166712"}], "block_device_mapping_v2": [{"uuid": "f9e39e35-b94f-4a26-87ca-c7eb363e6a57", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "060511a0-e46f-4c0e-a70d-d0864d8ba380"}]}} {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:40:55.061817 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-76b114ef-af9d-4345-b661-271ce8655003 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:40:55.062532 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-76b114ef-af9d-4345-b661-271ce8655003 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: ba748986-dc18-4e3c-98fd-f3f0a6a46e2e] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:40:55.069191 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-76b114ef-af9d-4345-b661-271ce8655003 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:55.069676 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-76b114ef-af9d-4345-b661-271ce8655003 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:55.070504 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-76b114ef-af9d-4345-b661-271ce8655003 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:55.070928 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-76b114ef-af9d-4345-b661-271ce8655003 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:55.186488 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.network.neutron [None req-974bb46a-5f36-494f-a4ec-ba6616c8bf78 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] validate_networks() for [('060511a0-e46f-4c0e-a70d-d0864d8ba380', None, None, None, None, None)] {{(pid=124298) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 12:40:55.319367 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-76b114ef-af9d-4345-b661-271ce8655003 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e935f2637d124453947b3c78360567a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359201313a944a8fa9881ee6fdea67e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:55.331810 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-76b114ef-af9d-4345-b661-271ce8655003 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "GET /compute/v2.1/servers/ba748986-dc18-4e3c-98fd-f3f0a6a46e2e" status: 200 len: 1367 microversion: 2.1 time: 0.274646 Jun 30 12:40:55.347699 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 407/802] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:40:55 2022] GET /compute/v2.1/servers/ba748986-dc18-4e3c-98fd-f3f0a6a46e2e => generated 1367 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:40:55.489867 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-73302733-d833-4f93-856c-99fd3d3a7c94 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:40:55.490199 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-73302733-d833-4f93-856c-99fd3d3a7c94 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] [instance: 17ef4273-4c60-498a-9061-2c4fbedbafdb] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:40:55.496886 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-73302733-d833-4f93-856c-99fd3d3a7c94 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:55.498353 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-73302733-d833-4f93-856c-99fd3d3a7c94 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:55.498353 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-73302733-d833-4f93-856c-99fd3d3a7c94 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:55.498569 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-73302733-d833-4f93-856c-99fd3d3a7c94 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:55.543781 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-73302733-d833-4f93-856c-99fd3d3a7c94 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:55.544277 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-73302733-d833-4f93-856c-99fd3d3a7c94 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:55.545237 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.objects.instance [None req-73302733-d833-4f93-856c-99fd3d3a7c94 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lazy-loading 'fault' on Instance uuid 17ef4273-4c60-498a-9061-2c4fbedbafdb {{(pid=124297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 12:40:55.611935 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-73302733-d833-4f93-856c-99fd3d3a7c94 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81aa9d47cd1470abef31a27839eaf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8abe616c14a4920b1cbc45733fa5771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:55.619840 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-73302733-d833-4f93-856c-99fd3d3a7c94 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] 10.222.0.57 "GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb" status: 200 len: 1224 microversion: 2.1 time: 0.134785 Jun 30 12:40:55.620417 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 408/803] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:40:55 2022] GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb => generated 1224 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 12:40:55.682500 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.virt.hardware [None req-974bb46a-5f36-494f-a4ec-ba6616c8bf78 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Flavor limits 0:0:0 {{(pid=124298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 12:40:55.683023 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.virt.hardware [None req-974bb46a-5f36-494f-a4ec-ba6616c8bf78 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Image limits 0:0:0 {{(pid=124298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 12:40:55.683449 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.virt.hardware [None req-974bb46a-5f36-494f-a4ec-ba6616c8bf78 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Flavor pref 0:0:0 {{(pid=124298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 12:40:55.683828 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.virt.hardware [None req-974bb46a-5f36-494f-a4ec-ba6616c8bf78 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Image pref 0:0:0 {{(pid=124298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 12:40:55.684258 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.virt.hardware [None req-974bb46a-5f36-494f-a4ec-ba6616c8bf78 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 12:40:55.694149 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-974bb46a-5f36-494f-a4ec-ba6616c8bf78 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:55.694622 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-974bb46a-5f36-494f-a4ec-ba6616c8bf78 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:55.695438 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-974bb46a-5f36-494f-a4ec-ba6616c8bf78 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:55.695876 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-974bb46a-5f36-494f-a4ec-ba6616c8bf78 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:55.713515 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.quota [None req-974bb46a-5f36-494f-a4ec-ba6616c8bf78 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Getting quotas for project c7b272349089480984fd1c5eabe6dce9. Resources: {'cores', 'ram', 'instances'} {{(pid=124298) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 12:40:55.717990 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.quota [None req-974bb46a-5f36-494f-a4ec-ba6616c8bf78 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Getting quotas for user 72419918d6c34080b6a4a4c73b2c06b2 and project c7b272349089480984fd1c5eabe6dce9. Resources: {'cores', 'ram', 'instances'} {{(pid=124298) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 12:40:55.785137 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-974bb46a-5f36-494f-a4ec-ba6616c8bf78 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Going to run 1 instances... {{(pid=124298) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 12:40:55.789695 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-974bb46a-5f36-494f-a4ec-ba6616c8bf78 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] [instance: 6c8d44a3-c5aa-4d56-9a74-ad0c7b75cacc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f9e39e35-b94f-4a26-87ca-c7eb363e6a57',volume_size=None,volume_type=None)] {{(pid=124298) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 12:40:55.933878 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-974bb46a-5f36-494f-a4ec-ba6616c8bf78 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.917977 Jun 30 12:40:55.934484 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 396/804] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 30 12:40:55 2022] POST /compute/v2.1/servers => generated 405 bytes in 919 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 12:40:55.944554 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-0f78b427-bd8c-4aad-88d6-5e7042c1aba5 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:40:55.945373 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-0f78b427-bd8c-4aad-88d6-5e7042c1aba5 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] [instance: 6c8d44a3-c5aa-4d56-9a74-ad0c7b75cacc] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:40:55.998690 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-0f78b427-bd8c-4aad-88d6-5e7042c1aba5 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72419918d6c34080b6a4a4c73b2c06b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b272349089480984fd1c5eabe6dce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:56.005414 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-0f78b427-bd8c-4aad-88d6-5e7042c1aba5 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] 10.222.0.57 "GET /compute/v2.1/servers/6c8d44a3-c5aa-4d56-9a74-ad0c7b75cacc" status: 200 len: 1095 microversion: 2.1 time: 0.064772 Jun 30 12:40:56.006181 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 409/805] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:40:55 2022] GET /compute/v2.1/servers/6c8d44a3-c5aa-4d56-9a74-ad0c7b75cacc => generated 1095 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:40:56.368064 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-9fd972f7-7714-4e20-9505-d01bfa5636ac tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:40:56.369431 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-9fd972f7-7714-4e20-9505-d01bfa5636ac tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: ba748986-dc18-4e3c-98fd-f3f0a6a46e2e] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:40:56.379673 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-9fd972f7-7714-4e20-9505-d01bfa5636ac tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:56.380385 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-9fd972f7-7714-4e20-9505-d01bfa5636ac tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:56.381698 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-9fd972f7-7714-4e20-9505-d01bfa5636ac tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:56.382416 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-9fd972f7-7714-4e20-9505-d01bfa5636ac tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:56.524714 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-9fd972f7-7714-4e20-9505-d01bfa5636ac tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e935f2637d124453947b3c78360567a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359201313a944a8fa9881ee6fdea67e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:56.532784 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-9fd972f7-7714-4e20-9505-d01bfa5636ac tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "GET /compute/v2.1/servers/ba748986-dc18-4e3c-98fd-f3f0a6a46e2e" status: 200 len: 1367 microversion: 2.1 time: 0.172003 Jun 30 12:40:56.533356 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 397/806] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:40:56 2022] GET /compute/v2.1/servers/ba748986-dc18-4e3c-98fd-f3f0a6a46e2e => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:40:56.641063 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-6fd1e63d-8be3-468c-a494-bbfdb7d2c7b7 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:40:56.642059 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-6fd1e63d-8be3-468c-a494-bbfdb7d2c7b7 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] [instance: 17ef4273-4c60-498a-9061-2c4fbedbafdb] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:40:56.654288 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-6fd1e63d-8be3-468c-a494-bbfdb7d2c7b7 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:56.655030 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-6fd1e63d-8be3-468c-a494-bbfdb7d2c7b7 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:56.656292 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-6fd1e63d-8be3-468c-a494-bbfdb7d2c7b7 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:56.657074 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-6fd1e63d-8be3-468c-a494-bbfdb7d2c7b7 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:56.692217 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-6fd1e63d-8be3-468c-a494-bbfdb7d2c7b7 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:56.692667 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-6fd1e63d-8be3-468c-a494-bbfdb7d2c7b7 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:56.693133 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.objects.instance [None req-6fd1e63d-8be3-468c-a494-bbfdb7d2c7b7 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lazy-loading 'fault' on Instance uuid 17ef4273-4c60-498a-9061-2c4fbedbafdb {{(pid=124297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 12:40:56.734339 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-6fd1e63d-8be3-468c-a494-bbfdb7d2c7b7 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81aa9d47cd1470abef31a27839eaf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8abe616c14a4920b1cbc45733fa5771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:56.742257 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-6fd1e63d-8be3-468c-a494-bbfdb7d2c7b7 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] 10.222.0.57 "GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb" status: 200 len: 1224 microversion: 2.1 time: 0.107800 Jun 30 12:40:56.743175 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 410/807] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:40:56 2022] GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb => generated 1224 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:40:56.932983 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [req-8a5f8581-a2ed-46a1-aefb-335106b42e06 req-28ad0527-2107-43f8-ac3b-4f0169c37aeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17ef4273-4c60-498a-9061-2c4fbedbafdb", "name": "network-vif-deleted", "tag": "7fb1dbc5-fce3-4c9f-bb9e-b486d232eebc"}]} {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:40:56.941577 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [req-8a5f8581-a2ed-46a1-aefb-335106b42e06 req-28ad0527-2107-43f8-ac3b-4f0169c37aeb service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:56.942015 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [req-8a5f8581-a2ed-46a1-aefb-335106b42e06 req-28ad0527-2107-43f8-ac3b-4f0169c37aeb service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:56.955286 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.compute.server_external_events [req-8a5f8581-a2ed-46a1-aefb-335106b42e06 req-28ad0527-2107-43f8-ac3b-4f0169c37aeb service nova] Creating event network-vif-deleted:7fb1dbc5-fce3-4c9f-bb9e-b486d232eebc for instance 17ef4273-4c60-498a-9061-2c4fbedbafdb on hv-cinder-84614 Jun 30 12:40:56.960659 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [req-8a5f8581-a2ed-46a1-aefb-335106b42e06 req-28ad0527-2107-43f8-ac3b-4f0169c37aeb service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033040 Jun 30 12:40:56.961248 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 398/808] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 30 12:40:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:40:57.022040 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-d1166274-ae2f-42a6-9ef9-de297137145a tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:40:57.023782 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-d1166274-ae2f-42a6-9ef9-de297137145a tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] [instance: 6c8d44a3-c5aa-4d56-9a74-ad0c7b75cacc] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:40:57.031106 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-d1166274-ae2f-42a6-9ef9-de297137145a tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:57.031869 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-d1166274-ae2f-42a6-9ef9-de297137145a tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:57.032932 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-d1166274-ae2f-42a6-9ef9-de297137145a tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:57.033585 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-d1166274-ae2f-42a6-9ef9-de297137145a tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:57.102592 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-d1166274-ae2f-42a6-9ef9-de297137145a tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72419918d6c34080b6a4a4c73b2c06b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b272349089480984fd1c5eabe6dce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:57.113576 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-d1166274-ae2f-42a6-9ef9-de297137145a tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] 10.222.0.57 "GET /compute/v2.1/servers/6c8d44a3-c5aa-4d56-9a74-ad0c7b75cacc" status: 200 len: 1145 microversion: 2.1 time: 0.095704 Jun 30 12:40:57.115261 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 411/809] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:40:57 2022] GET /compute/v2.1/servers/6c8d44a3-c5aa-4d56-9a74-ad0c7b75cacc => generated 1145 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:40:57.550598 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-79083e13-398d-415b-8ccb-efc9f77907b9 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:40:57.551287 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-79083e13-398d-415b-8ccb-efc9f77907b9 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: ba748986-dc18-4e3c-98fd-f3f0a6a46e2e] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:40:57.561072 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-79083e13-398d-415b-8ccb-efc9f77907b9 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:57.561967 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-79083e13-398d-415b-8ccb-efc9f77907b9 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:57.562461 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-79083e13-398d-415b-8ccb-efc9f77907b9 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:57.562888 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-79083e13-398d-415b-8ccb-efc9f77907b9 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:57.696531 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-79083e13-398d-415b-8ccb-efc9f77907b9 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e935f2637d124453947b3c78360567a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359201313a944a8fa9881ee6fdea67e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:57.703969 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-79083e13-398d-415b-8ccb-efc9f77907b9 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "GET /compute/v2.1/servers/ba748986-dc18-4e3c-98fd-f3f0a6a46e2e" status: 200 len: 1367 microversion: 2.1 time: 0.158051 Jun 30 12:40:57.704497 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 399/810] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:40:57 2022] GET /compute/v2.1/servers/ba748986-dc18-4e3c-98fd-f3f0a6a46e2e => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:40:57.763126 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-8480a78b-e17c-4a16-a3f3-54dad442e65b tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:40:57.763819 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-8480a78b-e17c-4a16-a3f3-54dad442e65b tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] [instance: 17ef4273-4c60-498a-9061-2c4fbedbafdb] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:40:57.772621 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-8480a78b-e17c-4a16-a3f3-54dad442e65b tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:57.773299 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-8480a78b-e17c-4a16-a3f3-54dad442e65b tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:57.774388 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-8480a78b-e17c-4a16-a3f3-54dad442e65b tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:57.775009 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-8480a78b-e17c-4a16-a3f3-54dad442e65b tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:57.789326 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.wsgi [None req-8480a78b-e17c-4a16-a3f3-54dad442e65b tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] HTTP exception thrown: Instance 17ef4273-4c60-498a-9061-2c4fbedbafdb could not be found. Jun 30 12:40:57.791078 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-8480a78b-e17c-4a16-a3f3-54dad442e65b tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Request method failure captured: Jun 30 12:40:57.791078 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: request: GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb HTTP/1.1 Jun 30 12:40:57.791078 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Accept: application/json Jun 30 12:40:57.791078 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Accept-Encoding: identity Jun 30 12:40:57.791078 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Connection: close Jun 30 12:40:57.791078 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Content-Length: 0 Jun 30 12:40:57.791078 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Content-Type: application/json Jun 30 12:40:57.791078 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Host: 10.222.0.57 Jun 30 12:40:57.791078 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Openstack-System-Scope: None Jun 30 12:40:57.791078 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: User-Agent: python-urllib3/1.26.9 Jun 30 12:40:57.791078 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Auth-Token: gAAAAABivZiELHZ4R0lQYXXlg56R5B3i64kiWqPa5QgMt9MpsOM0-f9lEPCf71qidNKopSXUbuXDSfIcVBK88nMcJ3okHic4454ib-WfqNKcCSYSDMnn-D8p4mrS-Su6R7a2AFnETD7dMWQ9FAy4UVG39r0Hk7SMKtEWTpnn4jWfoa5HuJ6NlJA Jun 30 12:40:57.791078 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Domain-Id: None Jun 30 12:40:57.791078 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Domain-Name: None Jun 30 12:40:57.791078 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Identity-Status: Confirmed Jun 30 12:40:57.791078 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Is-Admin-Project: True Jun 30 12:40:57.791078 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Project-Domain-Id: default Jun 30 12:40:57.791078 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Project-Domain-Name: Default Jun 30 12:40:57.791078 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Project-Id: e8abe616c14a4920b1cbc45733fa5771 Jun 30 12:40:57.791078 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Project-Name: tempest-TestShelveInstance-988685469 Jun 30 12:40:57.791078 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Role: member,reader Jun 30 12:40:57.791078 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Roles: member,reader Jun 30 12:40:57.792721 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/e8abe616c14a4920b1cbc45733fa5771"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e8abe616c14a4920b1cbc45733fa5771"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_e8abe616c14a4920b1cbc45733fa5771", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e8abe616c14a4920b1cbc45733fa5771"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 30 12:40:57.792721 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Tenant: tempest-TestShelveInstance-988685469 Jun 30 12:40:57.792721 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Tenant-Id: e8abe616c14a4920b1cbc45733fa5771 Jun 30 12:40:57.792721 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Tenant-Name: tempest-TestShelveInstance-988685469 Jun 30 12:40:57.792721 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User: tempest-TestShelveInstance-988685469-project Jun 30 12:40:57.792721 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User-Domain-Id: default Jun 30 12:40:57.792721 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User-Domain-Name: Default Jun 30 12:40:57.792721 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User-Id: e81aa9d47cd1470abef31a27839eaf86 Jun 30 12:40:57.792721 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User-Name: tempest-TestShelveInstance-988685469-project Jun 30 12:40:57.792721 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: method: > Jun 30 12:40:57.792721 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: exception: Instance 17ef4273-4c60-498a-9061-2c4fbedbafdb could not be found. Jun 30 12:40:57.792721 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: action_args: {'id': '17ef4273-4c60-498a-9061-2c4fbedbafdb'} Jun 30 12:40:57.793688 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 12:40:57.793688 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:40:57.793688 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 12:40:57.793688 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 12:40:57.793688 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 12:40:57.793688 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 12:40:57.793688 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 12:40:57.793688 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 12:40:57.793688 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 12:40:57.793688 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 12:40:57.793688 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17ef4273-4c60-498a-9061-2c4fbedbafdb could not be found. Jun 30 12:40:57.793688 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:40:57.793688 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:40:57.793688 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:40:57.793688 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:40:57.793688 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:40:57.793688 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:40:57.793688 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 12:40:57.793688 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 12:40:57.793688 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 12:40:57.795341 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 12:40:57.795341 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 12:40:57.795341 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 12:40:57.795341 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 12:40:57.795341 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 12:40:57.795341 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 12:40:57.795341 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 12:40:57.795341 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17ef4273-4c60-498a-9061-2c4fbedbafdb could not be found. Jun 30 12:40:57.795341 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:40:57.795341 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:40:57.795341 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:40:57.795341 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:40:57.795341 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:40:57.795341 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:40:57.795341 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 12:40:57.795341 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 12:40:57.795341 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17ef4273-4c60-498a-9061-2c4fbedbafdb could not be found. Jun 30 12:40:57.795341 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:40:57.796741 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-8480a78b-e17c-4a16-a3f3-54dad442e65b tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Returning 404 to user: Instance 17ef4273-4c60-498a-9061-2c4fbedbafdb could not be found. {{(pid=124297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 12:40:57.796741 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-8480a78b-e17c-4a16-a3f3-54dad442e65b tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] 10.222.0.57 "GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb" status: 404 len: 111 microversion: 2.1 time: 0.035663 Jun 30 12:40:57.796741 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 412/811] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:40:57 2022] GET /compute/v2.1/servers/17ef4273-4c60-498a-9061-2c4fbedbafdb => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 12:40:58.010610 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-2cca3c32-ea2d-48b6-8011-f722f935be20 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] Calling method '.version_select at 0x7fd0e008cee0>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:40:58.029606 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-2cca3c32-ea2d-48b6-8011-f722f935be20 tempest-TestShelveInstance-988685469 tempest-TestShelveInstance-988685469-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-612499850" status: 202 len: 0 microversion: 2.1 time: 0.023127 Jun 30 12:40:58.037034 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 400/812] 10.222.0.57 () {58 vars in 1250 bytes} [Thu Jun 30 12:40:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-612499850 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 12:40:58.131630 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-3e935987-6e14-467f-8c9b-a39bc6e45c0b tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:40:58.132244 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-3e935987-6e14-467f-8c9b-a39bc6e45c0b tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] [instance: 6c8d44a3-c5aa-4d56-9a74-ad0c7b75cacc] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:40:58.139343 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-3e935987-6e14-467f-8c9b-a39bc6e45c0b tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:58.140065 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-3e935987-6e14-467f-8c9b-a39bc6e45c0b tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:58.141314 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-3e935987-6e14-467f-8c9b-a39bc6e45c0b tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:58.142376 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-3e935987-6e14-467f-8c9b-a39bc6e45c0b tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:58.233491 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-3e935987-6e14-467f-8c9b-a39bc6e45c0b tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72419918d6c34080b6a4a4c73b2c06b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b272349089480984fd1c5eabe6dce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:58.241111 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-3e935987-6e14-467f-8c9b-a39bc6e45c0b tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] 10.222.0.57 "GET /compute/v2.1/servers/6c8d44a3-c5aa-4d56-9a74-ad0c7b75cacc" status: 200 len: 1211 microversion: 2.1 time: 0.113223 Jun 30 12:40:58.244304 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 413/813] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:40:58 2022] GET /compute/v2.1/servers/6c8d44a3-c5aa-4d56-9a74-ad0c7b75cacc => generated 1211 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:40:58.720966 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-e78b5334-e1de-41f7-8590-a44ff0048e9c tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:40:58.721759 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-e78b5334-e1de-41f7-8590-a44ff0048e9c tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: ba748986-dc18-4e3c-98fd-f3f0a6a46e2e] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:40:58.730425 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-e78b5334-e1de-41f7-8590-a44ff0048e9c tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:58.731253 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-e78b5334-e1de-41f7-8590-a44ff0048e9c tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:58.732720 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-e78b5334-e1de-41f7-8590-a44ff0048e9c tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:58.733321 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-e78b5334-e1de-41f7-8590-a44ff0048e9c tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:59.259709 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-b72e2082-44cf-42c2-b5a7-9cb9d2ccce28 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:40:59.260557 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-b72e2082-44cf-42c2-b5a7-9cb9d2ccce28 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] [instance: 6c8d44a3-c5aa-4d56-9a74-ad0c7b75cacc] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:40:59.270390 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-b72e2082-44cf-42c2-b5a7-9cb9d2ccce28 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:59.271386 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-b72e2082-44cf-42c2-b5a7-9cb9d2ccce28 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:59.272367 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-b72e2082-44cf-42c2-b5a7-9cb9d2ccce28 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:40:59.273039 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-b72e2082-44cf-42c2-b5a7-9cb9d2ccce28 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:40:59.392421 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-e78b5334-e1de-41f7-8590-a44ff0048e9c tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e935f2637d124453947b3c78360567a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359201313a944a8fa9881ee6fdea67e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:59.415859 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-e78b5334-e1de-41f7-8590-a44ff0048e9c tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "GET /compute/v2.1/servers/ba748986-dc18-4e3c-98fd-f3f0a6a46e2e" status: 200 len: 1367 microversion: 2.1 time: 0.697191 Jun 30 12:40:59.425920 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 401/814] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:40:58 2022] GET /compute/v2.1/servers/ba748986-dc18-4e3c-98fd-f3f0a6a46e2e => generated 1367 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:40:59.528892 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-b72e2082-44cf-42c2-b5a7-9cb9d2ccce28 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72419918d6c34080b6a4a4c73b2c06b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b272349089480984fd1c5eabe6dce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:40:59.538451 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-b72e2082-44cf-42c2-b5a7-9cb9d2ccce28 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] 10.222.0.57 "GET /compute/v2.1/servers/6c8d44a3-c5aa-4d56-9a74-ad0c7b75cacc" status: 200 len: 1266 microversion: 2.1 time: 0.283350 Jun 30 12:40:59.539020 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 414/815] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:40:59 2022] GET /compute/v2.1/servers/6c8d44a3-c5aa-4d56-9a74-ad0c7b75cacc => generated 1266 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 12:41:00.019336 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [req-4b6eef5a-1e44-4670-968b-6a9e10415a38 req-ac5af8af-c77f-4c5e-8466-ac1dd29fab03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c8d44a3-c5aa-4d56-9a74-ad0c7b75cacc", "tag": "df846a02-3229-4085-9232-fce8e68d513e"}]} {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:41:00.030821 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [req-4b6eef5a-1e44-4670-968b-6a9e10415a38 req-ac5af8af-c77f-4c5e-8466-ac1dd29fab03 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:00.031676 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [req-4b6eef5a-1e44-4670-968b-6a9e10415a38 req-ac5af8af-c77f-4c5e-8466-ac1dd29fab03 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:00.045007 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.compute.server_external_events [req-4b6eef5a-1e44-4670-968b-6a9e10415a38 req-ac5af8af-c77f-4c5e-8466-ac1dd29fab03 service nova] Creating event network-changed:df846a02-3229-4085-9232-fce8e68d513e for instance 6c8d44a3-c5aa-4d56-9a74-ad0c7b75cacc on hv-cinder-84614 Jun 30 12:41:00.051217 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [req-4b6eef5a-1e44-4670-968b-6a9e10415a38 req-ac5af8af-c77f-4c5e-8466-ac1dd29fab03 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035706 Jun 30 12:41:00.052234 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 402/816] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 30 12:41:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:41:00.433411 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-33dc8185-cf78-4cf4-b045-5a3a36a758ce tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:41:00.434757 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-33dc8185-cf78-4cf4-b045-5a3a36a758ce tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: ba748986-dc18-4e3c-98fd-f3f0a6a46e2e] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:41:00.442088 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-33dc8185-cf78-4cf4-b045-5a3a36a758ce tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:00.443280 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-33dc8185-cf78-4cf4-b045-5a3a36a758ce tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:00.444305 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-33dc8185-cf78-4cf4-b045-5a3a36a758ce tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:00.444990 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-33dc8185-cf78-4cf4-b045-5a3a36a758ce tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:00.557247 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-3568533b-6142-49d4-ae46-6f9ea6f0cd9f tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:41:00.558636 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-3568533b-6142-49d4-ae46-6f9ea6f0cd9f tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] [instance: 6c8d44a3-c5aa-4d56-9a74-ad0c7b75cacc] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:41:00.568877 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-3568533b-6142-49d4-ae46-6f9ea6f0cd9f tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:00.569584 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-3568533b-6142-49d4-ae46-6f9ea6f0cd9f tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:00.571219 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-3568533b-6142-49d4-ae46-6f9ea6f0cd9f tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:00.573053 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-3568533b-6142-49d4-ae46-6f9ea6f0cd9f tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:00.736304 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-33dc8185-cf78-4cf4-b045-5a3a36a758ce tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e935f2637d124453947b3c78360567a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359201313a944a8fa9881ee6fdea67e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:41:00.744905 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-33dc8185-cf78-4cf4-b045-5a3a36a758ce tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "GET /compute/v2.1/servers/ba748986-dc18-4e3c-98fd-f3f0a6a46e2e" status: 200 len: 1367 microversion: 2.1 time: 0.316007 Jun 30 12:41:00.754504 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 415/817] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:41:00 2022] GET /compute/v2.1/servers/ba748986-dc18-4e3c-98fd-f3f0a6a46e2e => generated 1367 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:41:00.839799 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-3568533b-6142-49d4-ae46-6f9ea6f0cd9f tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72419918d6c34080b6a4a4c73b2c06b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b272349089480984fd1c5eabe6dce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:41:00.847663 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-3568533b-6142-49d4-ae46-6f9ea6f0cd9f tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] 10.222.0.57 "GET /compute/v2.1/servers/6c8d44a3-c5aa-4d56-9a74-ad0c7b75cacc" status: 200 len: 1266 microversion: 2.1 time: 0.295684 Jun 30 12:41:00.848462 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 403/818] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:41:00 2022] GET /compute/v2.1/servers/6c8d44a3-c5aa-4d56-9a74-ad0c7b75cacc => generated 1266 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:41:01.356187 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [req-f241dca6-8909-4ce7-af9f-91b793eff8e5 req-51b92687-31a3-4bd9-a342-b0beda789f5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba748986-dc18-4e3c-98fd-f3f0a6a46e2e", "name": "network-vif-plugged", "status": "completed", "tag": "d9729688-4600-45ad-a9ec-544e2a25a91a"}]} {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:41:01.370481 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [req-f241dca6-8909-4ce7-af9f-91b793eff8e5 req-51b92687-31a3-4bd9-a342-b0beda789f5f service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:01.372463 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [req-f241dca6-8909-4ce7-af9f-91b793eff8e5 req-51b92687-31a3-4bd9-a342-b0beda789f5f service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:01.385729 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.compute.server_external_events [req-f241dca6-8909-4ce7-af9f-91b793eff8e5 req-51b92687-31a3-4bd9-a342-b0beda789f5f service nova] Creating event network-vif-plugged:d9729688-4600-45ad-a9ec-544e2a25a91a for instance ba748986-dc18-4e3c-98fd-f3f0a6a46e2e on hv-cinder-84614 Jun 30 12:41:01.393132 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [req-f241dca6-8909-4ce7-af9f-91b793eff8e5 req-51b92687-31a3-4bd9-a342-b0beda789f5f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041119 Jun 30 12:41:01.393966 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 416/819] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 30 12:41:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:41:01.762120 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-7aed2363-03c8-42cb-b9a3-e78afba6f9b9 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:41:01.762664 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-7aed2363-03c8-42cb-b9a3-e78afba6f9b9 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: ba748986-dc18-4e3c-98fd-f3f0a6a46e2e] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:41:01.771999 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-7aed2363-03c8-42cb-b9a3-e78afba6f9b9 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:01.772448 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-7aed2363-03c8-42cb-b9a3-e78afba6f9b9 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:01.773606 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-7aed2363-03c8-42cb-b9a3-e78afba6f9b9 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:01.774050 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-7aed2363-03c8-42cb-b9a3-e78afba6f9b9 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:01.873848 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-8b01635b-4a57-41e4-9ff9-5beec944c170 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:41:01.883185 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-8b01635b-4a57-41e4-9ff9-5beec944c170 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] [instance: 6c8d44a3-c5aa-4d56-9a74-ad0c7b75cacc] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:41:01.893308 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-8b01635b-4a57-41e4-9ff9-5beec944c170 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:01.894000 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-8b01635b-4a57-41e4-9ff9-5beec944c170 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:01.895780 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-8b01635b-4a57-41e4-9ff9-5beec944c170 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:01.897065 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-8b01635b-4a57-41e4-9ff9-5beec944c170 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:01.979250 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-7aed2363-03c8-42cb-b9a3-e78afba6f9b9 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e935f2637d124453947b3c78360567a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359201313a944a8fa9881ee6fdea67e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:41:01.988540 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-7aed2363-03c8-42cb-b9a3-e78afba6f9b9 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "GET /compute/v2.1/servers/ba748986-dc18-4e3c-98fd-f3f0a6a46e2e" status: 200 len: 1367 microversion: 2.1 time: 0.230535 Jun 30 12:41:01.999515 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 404/820] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:41:01 2022] GET /compute/v2.1/servers/ba748986-dc18-4e3c-98fd-f3f0a6a46e2e => generated 1367 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:41:02.175502 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-8b01635b-4a57-41e4-9ff9-5beec944c170 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72419918d6c34080b6a4a4c73b2c06b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b272349089480984fd1c5eabe6dce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:41:02.184799 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-8b01635b-4a57-41e4-9ff9-5beec944c170 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] 10.222.0.57 "GET /compute/v2.1/servers/6c8d44a3-c5aa-4d56-9a74-ad0c7b75cacc" status: 200 len: 1266 microversion: 2.1 time: 0.317055 Jun 30 12:41:02.185490 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 417/821] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:41:01 2022] GET /compute/v2.1/servers/6c8d44a3-c5aa-4d56-9a74-ad0c7b75cacc => generated 1266 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 12:41:03.006517 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-c04e4070-a690-4051-b192-984e1f89c14b tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:41:03.007132 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-c04e4070-a690-4051-b192-984e1f89c14b tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: ba748986-dc18-4e3c-98fd-f3f0a6a46e2e] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:41:03.013746 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-c04e4070-a690-4051-b192-984e1f89c14b tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:03.014226 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-c04e4070-a690-4051-b192-984e1f89c14b tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:03.014997 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-c04e4070-a690-4051-b192-984e1f89c14b tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:03.015438 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-c04e4070-a690-4051-b192-984e1f89c14b tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:03.019649 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG dbcounter [-] [124298] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:41:03.159052 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-c04e4070-a690-4051-b192-984e1f89c14b tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e935f2637d124453947b3c78360567a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359201313a944a8fa9881ee6fdea67e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:41:03.183056 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-c04e4070-a690-4051-b192-984e1f89c14b tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "GET /compute/v2.1/servers/ba748986-dc18-4e3c-98fd-f3f0a6a46e2e" status: 200 len: 1367 microversion: 2.1 time: 0.180462 Jun 30 12:41:03.183666 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 405/822] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:41:03 2022] GET /compute/v2.1/servers/ba748986-dc18-4e3c-98fd-f3f0a6a46e2e => generated 1367 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:41:03.202706 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-cf26c556-3456-4c1b-af5a-0f1e4fe83d0c tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:41:03.203404 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-cf26c556-3456-4c1b-af5a-0f1e4fe83d0c tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] [instance: 6c8d44a3-c5aa-4d56-9a74-ad0c7b75cacc] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:41:03.210925 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-cf26c556-3456-4c1b-af5a-0f1e4fe83d0c tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:03.211780 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-cf26c556-3456-4c1b-af5a-0f1e4fe83d0c tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:03.213227 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-cf26c556-3456-4c1b-af5a-0f1e4fe83d0c tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:03.214039 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-cf26c556-3456-4c1b-af5a-0f1e4fe83d0c tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:03.362415 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-cf26c556-3456-4c1b-af5a-0f1e4fe83d0c tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72419918d6c34080b6a4a4c73b2c06b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b272349089480984fd1c5eabe6dce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:41:03.370713 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-cf26c556-3456-4c1b-af5a-0f1e4fe83d0c tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] 10.222.0.57 "GET /compute/v2.1/servers/6c8d44a3-c5aa-4d56-9a74-ad0c7b75cacc" status: 200 len: 1266 microversion: 2.1 time: 0.171882 Jun 30 12:41:03.380241 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 418/823] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:41:03 2022] GET /compute/v2.1/servers/6c8d44a3-c5aa-4d56-9a74-ad0c7b75cacc => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:41:04.201299 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-eb8ef9b9-5351-4796-96b2-e889733a6aca tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:41:04.202074 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-eb8ef9b9-5351-4796-96b2-e889733a6aca tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: ba748986-dc18-4e3c-98fd-f3f0a6a46e2e] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:41:04.211203 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-eb8ef9b9-5351-4796-96b2-e889733a6aca tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:04.211780 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-eb8ef9b9-5351-4796-96b2-e889733a6aca tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:04.213263 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-eb8ef9b9-5351-4796-96b2-e889733a6aca tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:04.214363 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-eb8ef9b9-5351-4796-96b2-e889733a6aca tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:04.388543 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-0fda1ccc-a798-4ddc-a6f1-d70def7261c8 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:41:04.389247 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-0fda1ccc-a798-4ddc-a6f1-d70def7261c8 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] [instance: 6c8d44a3-c5aa-4d56-9a74-ad0c7b75cacc] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:41:04.397415 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-0fda1ccc-a798-4ddc-a6f1-d70def7261c8 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:04.397938 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-0fda1ccc-a798-4ddc-a6f1-d70def7261c8 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:04.398770 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-0fda1ccc-a798-4ddc-a6f1-d70def7261c8 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:04.399441 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-0fda1ccc-a798-4ddc-a6f1-d70def7261c8 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:04.465660 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-eb8ef9b9-5351-4796-96b2-e889733a6aca tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e935f2637d124453947b3c78360567a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359201313a944a8fa9881ee6fdea67e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:41:04.473817 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-eb8ef9b9-5351-4796-96b2-e889733a6aca tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "GET /compute/v2.1/servers/ba748986-dc18-4e3c-98fd-f3f0a6a46e2e" status: 200 len: 1556 microversion: 2.1 time: 0.277586 Jun 30 12:41:04.474692 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 406/824] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:41:04 2022] GET /compute/v2.1/servers/ba748986-dc18-4e3c-98fd-f3f0a6a46e2e => generated 1556 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:41:04.490464 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-d54bb9c4-6656-47c9-95ca-773990a50fba tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:41:04.491209 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-d54bb9c4-6656-47c9-95ca-773990a50fba tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: ba748986-dc18-4e3c-98fd-f3f0a6a46e2e] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:41:04.497649 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-d54bb9c4-6656-47c9-95ca-773990a50fba tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:04.498282 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-d54bb9c4-6656-47c9-95ca-773990a50fba tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:04.499059 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-d54bb9c4-6656-47c9-95ca-773990a50fba tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:04.499480 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-d54bb9c4-6656-47c9-95ca-773990a50fba tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:04.659820 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-d54bb9c4-6656-47c9-95ca-773990a50fba tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "GET /compute/v2.1/servers/ba748986-dc18-4e3c-98fd-f3f0a6a46e2e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.173104 Jun 30 12:41:04.660442 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 407/825] 10.222.0.57 () {58 vars in 1274 bytes} [Thu Jun 30 12:41:04 2022] GET /compute/v2.1/servers/ba748986-dc18-4e3c-98fd-f3f0a6a46e2e/os-interface => generated 284 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 12:41:04.669561 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-0fda1ccc-a798-4ddc-a6f1-d70def7261c8 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72419918d6c34080b6a4a4c73b2c06b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b272349089480984fd1c5eabe6dce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:41:04.678681 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-0fda1ccc-a798-4ddc-a6f1-d70def7261c8 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] 10.222.0.57 "GET /compute/v2.1/servers/6c8d44a3-c5aa-4d56-9a74-ad0c7b75cacc" status: 200 len: 1266 microversion: 2.1 time: 0.293813 Jun 30 12:41:04.678681 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 419/826] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:41:04 2022] GET /compute/v2.1/servers/6c8d44a3-c5aa-4d56-9a74-ad0c7b75cacc => generated 1266 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:41:05.697411 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-956295b0-4933-484f-a586-b6bdf5c379d5 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:41:05.698696 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-956295b0-4933-484f-a586-b6bdf5c379d5 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] [instance: 6c8d44a3-c5aa-4d56-9a74-ad0c7b75cacc] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:41:05.701987 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG dbcounter [-] [124298] Writing DB stats nova_cell0:SELECT=4 {{(pid=124298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:41:05.709880 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-956295b0-4933-484f-a586-b6bdf5c379d5 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:05.711089 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-956295b0-4933-484f-a586-b6bdf5c379d5 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:05.712090 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-956295b0-4933-484f-a586-b6bdf5c379d5 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:05.712843 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-956295b0-4933-484f-a586-b6bdf5c379d5 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:05.733593 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG dbcounter [-] [124298] Writing DB stats nova_cell0:SELECT=12 {{(pid=124298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:41:05.957693 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-956295b0-4933-484f-a586-b6bdf5c379d5 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72419918d6c34080b6a4a4c73b2c06b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b272349089480984fd1c5eabe6dce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:41:05.971986 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-956295b0-4933-484f-a586-b6bdf5c379d5 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] 10.222.0.57 "GET /compute/v2.1/servers/6c8d44a3-c5aa-4d56-9a74-ad0c7b75cacc" status: 200 len: 1266 microversion: 2.1 time: 0.280330 Jun 30 12:41:05.973275 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 408/827] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:41:05 2022] GET /compute/v2.1/servers/6c8d44a3-c5aa-4d56-9a74-ad0c7b75cacc => generated 1266 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:41:06.251457 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [req-7f94dadb-5799-42bd-8a95-09a0066d0ced req-ed14e08f-a50b-4748-98a0-5131488d577e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba748986-dc18-4e3c-98fd-f3f0a6a46e2e", "tag": "d9729688-4600-45ad-a9ec-544e2a25a91a"}]} {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:41:06.259078 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG dbcounter [-] [124297] Writing DB stats nova_cell0:SELECT=8 {{(pid=124297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:41:06.262523 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [req-7f94dadb-5799-42bd-8a95-09a0066d0ced req-ed14e08f-a50b-4748-98a0-5131488d577e service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:06.263063 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [req-7f94dadb-5799-42bd-8a95-09a0066d0ced req-ed14e08f-a50b-4748-98a0-5131488d577e service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:06.267826 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG dbcounter [-] [124297] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:41:06.279654 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.compute.server_external_events [req-7f94dadb-5799-42bd-8a95-09a0066d0ced req-ed14e08f-a50b-4748-98a0-5131488d577e service nova] Creating event network-changed:d9729688-4600-45ad-a9ec-544e2a25a91a for instance ba748986-dc18-4e3c-98fd-f3f0a6a46e2e on hv-cinder-84614 Jun 30 12:41:06.293388 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [req-7f94dadb-5799-42bd-8a95-09a0066d0ced req-ed14e08f-a50b-4748-98a0-5131488d577e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045167 Jun 30 12:41:06.294745 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 420/828] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 30 12:41:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:41:06.991424 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-1b7f505a-7d7c-40d5-a3d3-4e354b2067b4 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:41:06.993677 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-1b7f505a-7d7c-40d5-a3d3-4e354b2067b4 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] [instance: 6c8d44a3-c5aa-4d56-9a74-ad0c7b75cacc] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:41:07.001707 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-1b7f505a-7d7c-40d5-a3d3-4e354b2067b4 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:07.002567 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-1b7f505a-7d7c-40d5-a3d3-4e354b2067b4 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:07.003710 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-1b7f505a-7d7c-40d5-a3d3-4e354b2067b4 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:07.004476 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-1b7f505a-7d7c-40d5-a3d3-4e354b2067b4 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:07.180250 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-1b7f505a-7d7c-40d5-a3d3-4e354b2067b4 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72419918d6c34080b6a4a4c73b2c06b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b272349089480984fd1c5eabe6dce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:41:07.189331 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-1b7f505a-7d7c-40d5-a3d3-4e354b2067b4 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] 10.222.0.57 "GET /compute/v2.1/servers/6c8d44a3-c5aa-4d56-9a74-ad0c7b75cacc" status: 200 len: 1266 microversion: 2.1 time: 0.203999 Jun 30 12:41:07.190553 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 409/829] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:41:06 2022] GET /compute/v2.1/servers/6c8d44a3-c5aa-4d56-9a74-ad0c7b75cacc => generated 1266 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:41:08.208166 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-6b4dec77-0943-4a21-8c1e-874391a255f9 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:41:08.208882 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-6b4dec77-0943-4a21-8c1e-874391a255f9 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] [instance: 6c8d44a3-c5aa-4d56-9a74-ad0c7b75cacc] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:41:08.216451 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-6b4dec77-0943-4a21-8c1e-874391a255f9 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:08.216924 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-6b4dec77-0943-4a21-8c1e-874391a255f9 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:08.217697 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-6b4dec77-0943-4a21-8c1e-874391a255f9 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:08.218126 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-6b4dec77-0943-4a21-8c1e-874391a255f9 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:08.355882 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-6b4dec77-0943-4a21-8c1e-874391a255f9 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72419918d6c34080b6a4a4c73b2c06b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b272349089480984fd1c5eabe6dce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:41:08.363555 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-6b4dec77-0943-4a21-8c1e-874391a255f9 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] 10.222.0.57 "GET /compute/v2.1/servers/6c8d44a3-c5aa-4d56-9a74-ad0c7b75cacc" status: 200 len: 1266 microversion: 2.1 time: 0.160543 Jun 30 12:41:08.364455 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 421/830] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:41:08 2022] GET /compute/v2.1/servers/6c8d44a3-c5aa-4d56-9a74-ad0c7b75cacc => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:41:09.384718 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-7f417783-6586-47f1-8bdb-88a7eaafbb62 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:41:09.386101 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-7f417783-6586-47f1-8bdb-88a7eaafbb62 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] [instance: 6c8d44a3-c5aa-4d56-9a74-ad0c7b75cacc] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:41:09.396940 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-7f417783-6586-47f1-8bdb-88a7eaafbb62 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:09.397678 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-7f417783-6586-47f1-8bdb-88a7eaafbb62 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:09.398924 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-7f417783-6586-47f1-8bdb-88a7eaafbb62 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:09.399643 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-7f417783-6586-47f1-8bdb-88a7eaafbb62 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:09.542643 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-7f417783-6586-47f1-8bdb-88a7eaafbb62 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72419918d6c34080b6a4a4c73b2c06b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b272349089480984fd1c5eabe6dce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:41:09.554599 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-7f417783-6586-47f1-8bdb-88a7eaafbb62 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] 10.222.0.57 "GET /compute/v2.1/servers/6c8d44a3-c5aa-4d56-9a74-ad0c7b75cacc" status: 200 len: 1266 microversion: 2.1 time: 0.176020 Jun 30 12:41:09.555424 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 410/831] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:41:09 2022] GET /compute/v2.1/servers/6c8d44a3-c5aa-4d56-9a74-ad0c7b75cacc => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:41:10.575176 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-816dbdfb-4d63-4d2b-8f91-ba8e2fd5a2bc tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:41:10.575769 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-816dbdfb-4d63-4d2b-8f91-ba8e2fd5a2bc tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] [instance: 6c8d44a3-c5aa-4d56-9a74-ad0c7b75cacc] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:41:10.578363 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG dbcounter [-] [124297] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=124297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:41:10.583820 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-816dbdfb-4d63-4d2b-8f91-ba8e2fd5a2bc tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:10.584268 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-816dbdfb-4d63-4d2b-8f91-ba8e2fd5a2bc tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:10.585055 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-816dbdfb-4d63-4d2b-8f91-ba8e2fd5a2bc tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:10.585485 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-816dbdfb-4d63-4d2b-8f91-ba8e2fd5a2bc tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:10.732969 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-816dbdfb-4d63-4d2b-8f91-ba8e2fd5a2bc tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72419918d6c34080b6a4a4c73b2c06b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b272349089480984fd1c5eabe6dce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:41:10.742363 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-816dbdfb-4d63-4d2b-8f91-ba8e2fd5a2bc tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] 10.222.0.57 "GET /compute/v2.1/servers/6c8d44a3-c5aa-4d56-9a74-ad0c7b75cacc" status: 200 len: 1266 microversion: 2.1 time: 0.172598 Jun 30 12:41:10.742962 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 422/832] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:41:10 2022] GET /compute/v2.1/servers/6c8d44a3-c5aa-4d56-9a74-ad0c7b75cacc => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:41:11.253931 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [req-7ff020af-93c0-4f1d-8768-2dbc48d2bcdc req-4d6bae38-76a7-47be-8337-3e0451d5dbb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c8d44a3-c5aa-4d56-9a74-ad0c7b75cacc", "name": "network-vif-plugged", "status": "completed", "tag": "df846a02-3229-4085-9232-fce8e68d513e"}]} {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:41:11.257802 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG dbcounter [-] [124298] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=124298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:41:11.263991 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [req-7ff020af-93c0-4f1d-8768-2dbc48d2bcdc req-4d6bae38-76a7-47be-8337-3e0451d5dbb7 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:11.264457 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [req-7ff020af-93c0-4f1d-8768-2dbc48d2bcdc req-4d6bae38-76a7-47be-8337-3e0451d5dbb7 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:11.279021 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.compute.server_external_events [req-7ff020af-93c0-4f1d-8768-2dbc48d2bcdc req-4d6bae38-76a7-47be-8337-3e0451d5dbb7 service nova] Creating event network-vif-plugged:df846a02-3229-4085-9232-fce8e68d513e for instance 6c8d44a3-c5aa-4d56-9a74-ad0c7b75cacc on hv-cinder-84614 Jun 30 12:41:11.284268 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [req-7ff020af-93c0-4f1d-8768-2dbc48d2bcdc req-4d6bae38-76a7-47be-8337-3e0451d5dbb7 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034111 Jun 30 12:41:11.284996 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 411/833] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 30 12:41:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:41:11.762586 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-e5a82b54-3861-4de9-b63a-9d7de7322183 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:41:11.763354 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-e5a82b54-3861-4de9-b63a-9d7de7322183 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] [instance: 6c8d44a3-c5aa-4d56-9a74-ad0c7b75cacc] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:41:11.772982 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-e5a82b54-3861-4de9-b63a-9d7de7322183 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:11.773615 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-e5a82b54-3861-4de9-b63a-9d7de7322183 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:11.774687 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-e5a82b54-3861-4de9-b63a-9d7de7322183 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:11.775301 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-e5a82b54-3861-4de9-b63a-9d7de7322183 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:11.925099 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-e5a82b54-3861-4de9-b63a-9d7de7322183 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72419918d6c34080b6a4a4c73b2c06b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b272349089480984fd1c5eabe6dce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:41:11.935517 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-e5a82b54-3861-4de9-b63a-9d7de7322183 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] 10.222.0.57 "GET /compute/v2.1/servers/6c8d44a3-c5aa-4d56-9a74-ad0c7b75cacc" status: 200 len: 1266 microversion: 2.1 time: 0.178776 Jun 30 12:41:11.936112 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 423/834] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:41:11 2022] GET /compute/v2.1/servers/6c8d44a3-c5aa-4d56-9a74-ad0c7b75cacc => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:41:12.959363 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-e8490cc8-242d-4725-8b5b-79de02750421 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:41:12.960927 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-e8490cc8-242d-4725-8b5b-79de02750421 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] [instance: 6c8d44a3-c5aa-4d56-9a74-ad0c7b75cacc] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:41:12.972246 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-e8490cc8-242d-4725-8b5b-79de02750421 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:12.973078 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-e8490cc8-242d-4725-8b5b-79de02750421 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:12.974407 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-e8490cc8-242d-4725-8b5b-79de02750421 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:12.975133 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-e8490cc8-242d-4725-8b5b-79de02750421 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:13.127706 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-e8490cc8-242d-4725-8b5b-79de02750421 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72419918d6c34080b6a4a4c73b2c06b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b272349089480984fd1c5eabe6dce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:41:13.139081 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-e8490cc8-242d-4725-8b5b-79de02750421 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] 10.222.0.57 "GET /compute/v2.1/servers/6c8d44a3-c5aa-4d56-9a74-ad0c7b75cacc" status: 200 len: 1453 microversion: 2.1 time: 0.187807 Jun 30 12:41:13.139866 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 412/835] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:41:12 2022] GET /compute/v2.1/servers/6c8d44a3-c5aa-4d56-9a74-ad0c7b75cacc => generated 1453 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:41:13.156237 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-1ac8b035-9100-4f1b-8e45-132e4e55b68c tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:41:13.156927 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-1ac8b035-9100-4f1b-8e45-132e4e55b68c tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] [instance: 6c8d44a3-c5aa-4d56-9a74-ad0c7b75cacc] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:41:13.164021 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-1ac8b035-9100-4f1b-8e45-132e4e55b68c tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:13.164467 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-1ac8b035-9100-4f1b-8e45-132e4e55b68c tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:13.165265 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-1ac8b035-9100-4f1b-8e45-132e4e55b68c tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:13.165698 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-1ac8b035-9100-4f1b-8e45-132e4e55b68c tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:13.305347 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-1ac8b035-9100-4f1b-8e45-132e4e55b68c tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72419918d6c34080b6a4a4c73b2c06b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b272349089480984fd1c5eabe6dce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:41:13.313229 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-1ac8b035-9100-4f1b-8e45-132e4e55b68c tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] 10.222.0.57 "GET /compute/v2.1/servers/6c8d44a3-c5aa-4d56-9a74-ad0c7b75cacc" status: 200 len: 1453 microversion: 2.1 time: 0.161358 Jun 30 12:41:13.313836 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 424/836] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:41:13 2022] GET /compute/v2.1/servers/6c8d44a3-c5aa-4d56-9a74-ad0c7b75cacc => generated 1453 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:41:14.424082 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-614e179e-5926-4fcb-8272-638befccc959 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:41:14.424698 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-614e179e-5926-4fcb-8272-638befccc959 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: 8d6c9ce4-3de7-47d1-8e5a-1abe9091129e] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:41:14.432066 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-614e179e-5926-4fcb-8272-638befccc959 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:14.432549 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-614e179e-5926-4fcb-8272-638befccc959 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:14.433341 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-614e179e-5926-4fcb-8272-638befccc959 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:14.433774 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-614e179e-5926-4fcb-8272-638befccc959 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:14.463531 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-614e179e-5926-4fcb-8272-638befccc959 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e/os-volume_attachments/48b3b847-538f-4331-90a2-eac9a04c793f" status: 200 len: 194 microversion: 2.20 time: 0.043555 Jun 30 12:41:14.464394 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 413/837] 10.222.0.57 () {60 vars in 1453 bytes} [Thu Jun 30 12:41:14 2022] GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e/os-volume_attachments/48b3b847-538f-4331-90a2-eac9a04c793f => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 12:41:14.527965 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-88e9ce61-090f-4828-a43d-c115545013f3 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:41:14.528491 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-88e9ce61-090f-4828-a43d-c115545013f3 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: 8d6c9ce4-3de7-47d1-8e5a-1abe9091129e] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:41:14.535033 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-88e9ce61-090f-4828-a43d-c115545013f3 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:14.535481 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-88e9ce61-090f-4828-a43d-c115545013f3 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:14.536248 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-88e9ce61-090f-4828-a43d-c115545013f3 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:14.536740 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-88e9ce61-090f-4828-a43d-c115545013f3 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:14.622363 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.objects.instance [None req-88e9ce61-090f-4828-a43d-c115545013f3 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lazy-loading 'services' on Instance uuid 8d6c9ce4-3de7-47d1-8e5a-1abe9091129e {{(pid=124297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 12:41:14.702969 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-88e9ce61-090f-4828-a43d-c115545013f3 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "DELETE /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e/os-volume_attachments/48b3b847-538f-4331-90a2-eac9a04c793f" status: 202 len: 0 microversion: 2.20 time: 0.178965 Jun 30 12:41:14.703958 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 425/838] 10.222.0.57 () {60 vars in 1456 bytes} [Thu Jun 30 12:41:14 2022] DELETE /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e/os-volume_attachments/48b3b847-538f-4331-90a2-eac9a04c793f => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 30 12:41:14.713124 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-6a58249a-a87a-45f0-a2ef-6e7a9dcf0e05 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:41:14.714533 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-6a58249a-a87a-45f0-a2ef-6e7a9dcf0e05 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: 8d6c9ce4-3de7-47d1-8e5a-1abe9091129e] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:41:14.721146 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-6a58249a-a87a-45f0-a2ef-6e7a9dcf0e05 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:14.721623 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-6a58249a-a87a-45f0-a2ef-6e7a9dcf0e05 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:14.722392 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-6a58249a-a87a-45f0-a2ef-6e7a9dcf0e05 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:14.722827 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-6a58249a-a87a-45f0-a2ef-6e7a9dcf0e05 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:14.760693 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-6a58249a-a87a-45f0-a2ef-6e7a9dcf0e05 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052088 Jun 30 12:41:14.761291 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 414/839] 10.222.0.57 () {60 vars in 1342 bytes} [Thu Jun 30 12:41:14 2022] GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 12:41:15.265582 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [req-a4fcb618-0862-4248-9b7b-9bf68a57a154 req-a31298fb-bc98-464c-ad9d-b7ffa453c63f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c8d44a3-c5aa-4d56-9a74-ad0c7b75cacc", "tag": "df846a02-3229-4085-9232-fce8e68d513e"}]} {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:41:15.274338 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [req-a4fcb618-0862-4248-9b7b-9bf68a57a154 req-a31298fb-bc98-464c-ad9d-b7ffa453c63f service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:15.274748 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [req-a4fcb618-0862-4248-9b7b-9bf68a57a154 req-a31298fb-bc98-464c-ad9d-b7ffa453c63f service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:15.286211 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.compute.server_external_events [req-a4fcb618-0862-4248-9b7b-9bf68a57a154 req-a31298fb-bc98-464c-ad9d-b7ffa453c63f service nova] Creating event network-changed:df846a02-3229-4085-9232-fce8e68d513e for instance 6c8d44a3-c5aa-4d56-9a74-ad0c7b75cacc on hv-cinder-84614 Jun 30 12:41:15.290986 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [req-a4fcb618-0862-4248-9b7b-9bf68a57a154 req-a31298fb-bc98-464c-ad9d-b7ffa453c63f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029600 Jun 30 12:41:15.291711 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 426/840] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 30 12:41:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:41:15.772832 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-fa41f5bc-18fb-4b46-a3ba-355cd9fe643e tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:41:15.773768 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-fa41f5bc-18fb-4b46-a3ba-355cd9fe643e tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: 8d6c9ce4-3de7-47d1-8e5a-1abe9091129e] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:41:15.781645 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-fa41f5bc-18fb-4b46-a3ba-355cd9fe643e tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:15.782084 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-fa41f5bc-18fb-4b46-a3ba-355cd9fe643e tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:15.782847 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-fa41f5bc-18fb-4b46-a3ba-355cd9fe643e tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:15.783273 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-fa41f5bc-18fb-4b46-a3ba-355cd9fe643e tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:15.814697 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-fa41f5bc-18fb-4b46-a3ba-355cd9fe643e tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045964 Jun 30 12:41:15.815568 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 415/841] 10.222.0.57 () {60 vars in 1342 bytes} [Thu Jun 30 12:41:15 2022] GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:41:15.885213 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-3bca62fe-e09d-4dbe-83b8-9b8979c81253 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:41:15.886074 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-3bca62fe-e09d-4dbe-83b8-9b8979c81253 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: 8d6c9ce4-3de7-47d1-8e5a-1abe9091129e] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:41:15.893436 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-3bca62fe-e09d-4dbe-83b8-9b8979c81253 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:15.893882 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-3bca62fe-e09d-4dbe-83b8-9b8979c81253 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:15.894658 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-3bca62fe-e09d-4dbe-83b8-9b8979c81253 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:15.895100 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-3bca62fe-e09d-4dbe-83b8-9b8979c81253 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:15.923664 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-3bca62fe-e09d-4dbe-83b8-9b8979c81253 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: 8d6c9ce4-3de7-47d1-8e5a-1abe9091129e] Going to try to terminate instance {{(pid=124297) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 12:41:16.006432 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-3bca62fe-e09d-4dbe-83b8-9b8979c81253 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "DELETE /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e" status: 204 len: 0 microversion: 2.20 time: 0.129501 Jun 30 12:41:16.007029 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 427/842] 10.222.0.57 () {60 vars in 1279 bytes} [Thu Jun 30 12:41:15 2022] DELETE /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 30 12:41:16.016349 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-247dace4-cbd3-4694-b79c-bdcbf734a95d tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:41:16.017041 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-247dace4-cbd3-4694-b79c-bdcbf734a95d tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: 8d6c9ce4-3de7-47d1-8e5a-1abe9091129e] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:41:16.023326 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-247dace4-cbd3-4694-b79c-bdcbf734a95d tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:16.023704 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-247dace4-cbd3-4694-b79c-bdcbf734a95d tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:16.024481 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-247dace4-cbd3-4694-b79c-bdcbf734a95d tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:16.024989 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-247dace4-cbd3-4694-b79c-bdcbf734a95d tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:16.163466 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-247dace4-cbd3-4694-b79c-bdcbf734a95d tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:41:16.172147 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-247dace4-cbd3-4694-b79c-bdcbf734a95d tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:41:16.173760 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-247dace4-cbd3-4694-b79c-bdcbf734a95d tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:41:16.175033 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-247dace4-cbd3-4694-b79c-bdcbf734a95d tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e" status: 200 len: 1722 microversion: 2.20 time: 0.163484 Jun 30 12:41:16.175660 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 416/843] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:41:16 2022] GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:41:17.194671 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-e00be09d-0933-4a32-aabc-c91ca9d256a9 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:41:17.195361 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-e00be09d-0933-4a32-aabc-c91ca9d256a9 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: 8d6c9ce4-3de7-47d1-8e5a-1abe9091129e] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:41:17.204237 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-e00be09d-0933-4a32-aabc-c91ca9d256a9 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:17.204757 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-e00be09d-0933-4a32-aabc-c91ca9d256a9 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:17.205896 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-e00be09d-0933-4a32-aabc-c91ca9d256a9 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:17.206482 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-e00be09d-0933-4a32-aabc-c91ca9d256a9 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:17.348880 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-e00be09d-0933-4a32-aabc-c91ca9d256a9 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:41:17.357623 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-e00be09d-0933-4a32-aabc-c91ca9d256a9 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:41:17.359083 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-e00be09d-0933-4a32-aabc-c91ca9d256a9 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:41:17.360234 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-e00be09d-0933-4a32-aabc-c91ca9d256a9 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e" status: 200 len: 1722 microversion: 2.20 time: 0.170347 Jun 30 12:41:17.360793 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 428/844] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:41:17 2022] GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 12:41:18.379343 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-093b045f-8906-419a-937c-2dfe33f3093d tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:41:18.380046 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-093b045f-8906-419a-937c-2dfe33f3093d tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: 8d6c9ce4-3de7-47d1-8e5a-1abe9091129e] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:41:18.387384 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-093b045f-8906-419a-937c-2dfe33f3093d tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:18.387916 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-093b045f-8906-419a-937c-2dfe33f3093d tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:18.388811 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-093b045f-8906-419a-937c-2dfe33f3093d tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:18.389319 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-093b045f-8906-419a-937c-2dfe33f3093d tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:18.454437 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-093b045f-8906-419a-937c-2dfe33f3093d tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:41:18.462458 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-093b045f-8906-419a-937c-2dfe33f3093d tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:41:18.464717 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-093b045f-8906-419a-937c-2dfe33f3093d tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:41:18.465872 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-093b045f-8906-419a-937c-2dfe33f3093d tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e" status: 200 len: 1655 microversion: 2.20 time: 0.090881 Jun 30 12:41:18.466420 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 417/845] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:41:18 2022] GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e => generated 1655 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:41:18.893627 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [req-034ed529-f75a-4147-9925-a0a586ed8dd4 req-98762c09-51e3-43ac-b5c6-d59e2e20a649 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d6c9ce4-3de7-47d1-8e5a-1abe9091129e", "name": "network-vif-deleted", "tag": "f52ef586-26d4-4590-b973-a09504ba1350"}]} {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:41:18.902802 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [req-034ed529-f75a-4147-9925-a0a586ed8dd4 req-98762c09-51e3-43ac-b5c6-d59e2e20a649 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:18.903274 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [req-034ed529-f75a-4147-9925-a0a586ed8dd4 req-98762c09-51e3-43ac-b5c6-d59e2e20a649 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:18.914940 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.compute.server_external_events [req-034ed529-f75a-4147-9925-a0a586ed8dd4 req-98762c09-51e3-43ac-b5c6-d59e2e20a649 service nova] Creating event network-vif-deleted:f52ef586-26d4-4590-b973-a09504ba1350 for instance 8d6c9ce4-3de7-47d1-8e5a-1abe9091129e on hv-cinder-84614 Jun 30 12:41:18.920182 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [req-034ed529-f75a-4147-9925-a0a586ed8dd4 req-98762c09-51e3-43ac-b5c6-d59e2e20a649 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030210 Jun 30 12:41:18.921068 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 429/846] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 30 12:41:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:41:19.483697 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-0226f38c-d27e-4fee-872a-18f304dc7f35 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:41:19.484264 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-0226f38c-d27e-4fee-872a-18f304dc7f35 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: 8d6c9ce4-3de7-47d1-8e5a-1abe9091129e] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:41:19.491656 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-0226f38c-d27e-4fee-872a-18f304dc7f35 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:19.492167 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-0226f38c-d27e-4fee-872a-18f304dc7f35 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:19.492980 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-0226f38c-d27e-4fee-872a-18f304dc7f35 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:19.493415 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-0226f38c-d27e-4fee-872a-18f304dc7f35 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:19.525844 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-0226f38c-d27e-4fee-872a-18f304dc7f35 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:19.526439 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-0226f38c-d27e-4fee-872a-18f304dc7f35 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:19.526631 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.objects.instance [None req-0226f38c-d27e-4fee-872a-18f304dc7f35 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lazy-loading 'fault' on Instance uuid 8d6c9ce4-3de7-47d1-8e5a-1abe9091129e {{(pid=124298) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 12:41:19.568349 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-0226f38c-d27e-4fee-872a-18f304dc7f35 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:41:19.576762 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-0226f38c-d27e-4fee-872a-18f304dc7f35 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:41:19.578264 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-0226f38c-d27e-4fee-872a-18f304dc7f35 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:41:19.579407 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-0226f38c-d27e-4fee-872a-18f304dc7f35 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e" status: 200 len: 1371 microversion: 2.20 time: 0.099880 Jun 30 12:41:19.579967 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 418/847] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:41:19 2022] GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e => generated 1371 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:41:20.604302 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-7d5df4f2-bfbc-492d-bd61-69bcddee9d7f tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:41:20.605034 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-7d5df4f2-bfbc-492d-bd61-69bcddee9d7f tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: 8d6c9ce4-3de7-47d1-8e5a-1abe9091129e] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:41:20.611798 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-7d5df4f2-bfbc-492d-bd61-69bcddee9d7f tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:20.612241 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-7d5df4f2-bfbc-492d-bd61-69bcddee9d7f tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:20.613043 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-7d5df4f2-bfbc-492d-bd61-69bcddee9d7f tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:20.613482 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-7d5df4f2-bfbc-492d-bd61-69bcddee9d7f tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:20.627062 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.wsgi [None req-7d5df4f2-bfbc-492d-bd61-69bcddee9d7f tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] HTTP exception thrown: Instance 8d6c9ce4-3de7-47d1-8e5a-1abe9091129e could not be found. Jun 30 12:41:20.628680 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-7d5df4f2-bfbc-492d-bd61-69bcddee9d7f tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Request method failure captured: Jun 30 12:41:20.628680 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: request: GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e HTTP/1.1 Jun 30 12:41:20.628680 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Accept: application/json Jun 30 12:41:20.628680 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Accept-Encoding: identity Jun 30 12:41:20.628680 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Connection: close Jun 30 12:41:20.628680 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Content-Length: 0 Jun 30 12:41:20.628680 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Content-Type: application/json Jun 30 12:41:20.628680 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Host: 10.222.0.57 Jun 30 12:41:20.628680 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Openstack-System-Scope: None Jun 30 12:41:20.628680 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: User-Agent: python-urllib3/1.26.9 Jun 30 12:41:20.628680 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Auth-Token: gAAAAABivZlaROdnd5QxkhuIoGlaxhh9_EvN9eNIc_8LDYjg8V94kYmSU5e1iPhpmwjGkeXlkqYNLOLauzfNQDlsXSZqYUyhNM8J47t8EIhIxNxWP2BFWfaOBSOeqSERhbG0jEoM9EadjaUhpukMX6UUoAtVKdwdCytF35PJxrzChA4U1rdtl1E Jun 30 12:41:20.628680 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Domain-Id: None Jun 30 12:41:20.628680 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Domain-Name: None Jun 30 12:41:20.628680 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Identity-Status: Confirmed Jun 30 12:41:20.628680 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Is-Admin-Project: True Jun 30 12:41:20.628680 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Openstack-Nova-Api-Version: 2.20 Jun 30 12:41:20.628680 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Project-Domain-Id: default Jun 30 12:41:20.628680 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Project-Domain-Name: Default Jun 30 12:41:20.628680 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Project-Id: 373556d3416e4db68d08897c3d7c0a54 Jun 30 12:41:20.628680 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-627819037 Jun 30 12:41:20.628680 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Role: member,reader Jun 30 12:41:20.628680 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Roles: member,reader Jun 30 12:41:20.630271 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/373556d3416e4db68d08897c3d7c0a54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/373556d3416e4db68d08897c3d7c0a54"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_373556d3416e4db68d08897c3d7c0a54", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/373556d3416e4db68d08897c3d7c0a54"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 30 12:41:20.630271 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Tenant: tempest-AttachVolumeShelveTestJSON-627819037 Jun 30 12:41:20.630271 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Tenant-Id: 373556d3416e4db68d08897c3d7c0a54 Jun 30 12:41:20.630271 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-627819037 Jun 30 12:41:20.630271 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User: tempest-AttachVolumeShelveTestJSON-627819037-project Jun 30 12:41:20.630271 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User-Domain-Id: default Jun 30 12:41:20.630271 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User-Domain-Name: Default Jun 30 12:41:20.630271 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User-Id: 7294e5eafdfc42fbac105cf58ee07b70 Jun 30 12:41:20.630271 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User-Name: tempest-AttachVolumeShelveTestJSON-627819037-project Jun 30 12:41:20.630271 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: method: > Jun 30 12:41:20.630271 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: exception: Instance 8d6c9ce4-3de7-47d1-8e5a-1abe9091129e could not be found. Jun 30 12:41:20.630271 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: action_args: {'id': '8d6c9ce4-3de7-47d1-8e5a-1abe9091129e'} Jun 30 12:41:20.631206 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 12:41:20.631206 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:41:20.631206 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 12:41:20.631206 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 12:41:20.631206 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 12:41:20.631206 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 12:41:20.631206 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 12:41:20.631206 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 12:41:20.631206 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 12:41:20.631206 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 12:41:20.631206 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d6c9ce4-3de7-47d1-8e5a-1abe9091129e could not be found. Jun 30 12:41:20.631206 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:41:20.631206 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:41:20.631206 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:41:20.631206 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:41:20.631206 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:41:20.631206 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:41:20.631206 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 12:41:20.631206 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 12:41:20.631206 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 12:41:20.632664 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 12:41:20.632664 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 12:41:20.632664 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 12:41:20.632664 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 12:41:20.632664 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 12:41:20.632664 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 12:41:20.632664 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 12:41:20.632664 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d6c9ce4-3de7-47d1-8e5a-1abe9091129e could not be found. Jun 30 12:41:20.632664 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:41:20.632664 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:41:20.632664 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:41:20.632664 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:41:20.632664 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:41:20.632664 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:41:20.632664 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 12:41:20.632664 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 12:41:20.632664 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d6c9ce4-3de7-47d1-8e5a-1abe9091129e could not be found. Jun 30 12:41:20.632664 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:41:20.634058 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-7d5df4f2-bfbc-492d-bd61-69bcddee9d7f tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Returning 404 to user: Instance 8d6c9ce4-3de7-47d1-8e5a-1abe9091129e could not be found. {{(pid=124297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 12:41:20.634058 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-7d5df4f2-bfbc-492d-bd61-69bcddee9d7f tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e" status: 404 len: 111 microversion: 2.20 time: 0.033842 Jun 30 12:41:20.634058 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 430/848] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:41:20 2022] GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 30 12:41:20.639684 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-414a0ba3-40de-40dd-a37a-d67b8528cd7e tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '.version_select at 0x7fd0e008c310>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:41:20.659306 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-414a0ba3-40de-40dd-a37a-d67b8528cd7e tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2090490146" status: 204 len: 0 microversion: 2.20 time: 0.023523 Jun 30 12:41:20.659859 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 419/849] 10.222.0.57 () {60 vars in 1261 bytes} [Thu Jun 30 12:41:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2090490146 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 30 12:41:21.304719 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-f6ff5449-1c90-4286-8bab-9c3c63702c05 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Action: 'create', calling method: .version_select at 0x7fd0daf41040>, body: {"keypair": {"name": "tempest-keypair-413530922", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMYA9YmoS1/Yx3WXR8+WKZ55vLSk3/DoOAd2f5kKytrygHCT0UeSQWLJ8KAS9FJQHzWInEJryAhpynG9ZoOA1onPogagH4HLuO0FMbFGutCgXXqqO5zvUtEzRa+p9Qb7tA=="}} {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:41:21.325283 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.quota [None req-f6ff5449-1c90-4286-8bab-9c3c63702c05 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Getting quotas for project 373556d3416e4db68d08897c3d7c0a54. Resources: {'key_pairs'} {{(pid=124297) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 12:41:21.329274 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.quota [None req-f6ff5449-1c90-4286-8bab-9c3c63702c05 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Getting quotas for user 7294e5eafdfc42fbac105cf58ee07b70 and project 373556d3416e4db68d08897c3d7c0a54. Resources: {'key_pairs'} {{(pid=124297) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 12:41:21.354333 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-f6ff5449-1c90-4286-8bab-9c3c63702c05 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.055300 Jun 30 12:41:21.354943 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 431/850] 10.222.0.57 () {62 vars in 1199 bytes} [Thu Jun 30 12:41:21 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 57 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 30 12:41:22.691217 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-15b36614-e7e7-4aab-8748-f2b27f8bdcea tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1995555231", "imageRef": "776a1662-a241-4e20-9a9c-e4743c64efd0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ea811a85-2dc6-4699-af53-031270ac60e2"}], "security_groups": [{"name": "tempest-securitygroup--1045869584"}], "key_name": "tempest-keypair-413530922", "user_data": "}} {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:41:22.794768 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.network.neutron [None req-15b36614-e7e7-4aab-8748-f2b27f8bdcea tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] validate_networks() for [('ea811a85-2dc6-4699-af53-031270ac60e2', None, None, None, None, None)] {{(pid=124298) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 12:41:23.173600 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.virt.hardware [None req-15b36614-e7e7-4aab-8748-f2b27f8bdcea tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Flavor limits 0:0:0 {{(pid=124298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 12:41:23.174085 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.virt.hardware [None req-15b36614-e7e7-4aab-8748-f2b27f8bdcea tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Image limits 0:0:0 {{(pid=124298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 12:41:23.174633 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.virt.hardware [None req-15b36614-e7e7-4aab-8748-f2b27f8bdcea tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Flavor pref 0:0:0 {{(pid=124298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 12:41:23.175113 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.virt.hardware [None req-15b36614-e7e7-4aab-8748-f2b27f8bdcea tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Image pref 0:0:0 {{(pid=124298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 12:41:23.175583 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.virt.hardware [None req-15b36614-e7e7-4aab-8748-f2b27f8bdcea tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 12:41:23.185516 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-15b36614-e7e7-4aab-8748-f2b27f8bdcea tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:23.185991 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-15b36614-e7e7-4aab-8748-f2b27f8bdcea tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:23.186784 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-15b36614-e7e7-4aab-8748-f2b27f8bdcea tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:23.187221 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-15b36614-e7e7-4aab-8748-f2b27f8bdcea tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:23.204187 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.quota [None req-15b36614-e7e7-4aab-8748-f2b27f8bdcea tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Getting quotas for project 373556d3416e4db68d08897c3d7c0a54. Resources: {'cores', 'ram', 'instances'} {{(pid=124298) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 12:41:23.208730 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.quota [None req-15b36614-e7e7-4aab-8748-f2b27f8bdcea tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Getting quotas for user 7294e5eafdfc42fbac105cf58ee07b70 and project 373556d3416e4db68d08897c3d7c0a54. Resources: {'cores', 'ram', 'instances'} {{(pid=124298) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 12:41:23.221239 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-15b36614-e7e7-4aab-8748-f2b27f8bdcea tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Going to run 1 instances... {{(pid=124298) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 12:41:23.223558 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-15b36614-e7e7-4aab-8748-f2b27f8bdcea tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='776a1662-a241-4e20-9a9c-e4743c64efd0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124298) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 12:41:23.272316 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-15b36614-e7e7-4aab-8748-f2b27f8bdcea tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.585568 Jun 30 12:41:23.272990 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 420/851] 10.222.0.57 () {62 vars in 1187 bytes} [Thu Jun 30 12:41:22 2022] POST /compute/v2.1/servers => generated 402 bytes in 587 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 30 12:41:23.284024 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-ab060763-3bd5-4acb-aed2-d6d439738029 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:41:23.284601 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-ab060763-3bd5-4acb-aed2-d6d439738029 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:41:23.344176 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-ab060763-3bd5-4acb-aed2-d6d439738029 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:41:23.351776 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-ab060763-3bd5-4acb-aed2-d6d439738029 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:41:23.353282 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-ab060763-3bd5-4acb-aed2-d6d439738029 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:41:23.354838 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-ab060763-3bd5-4acb-aed2-d6d439738029 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 200 len: 1281 microversion: 2.20 time: 0.075272 Jun 30 12:41:23.355396 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 432/852] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:41:23 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 1281 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:41:24.374566 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-245d204d-ed13-47b5-a4af-bf8c1d45a070 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:41:24.375240 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-245d204d-ed13-47b5-a4af-bf8c1d45a070 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:41:24.382332 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-245d204d-ed13-47b5-a4af-bf8c1d45a070 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:24.382785 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-245d204d-ed13-47b5-a4af-bf8c1d45a070 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:24.383525 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-245d204d-ed13-47b5-a4af-bf8c1d45a070 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:24.384176 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-245d204d-ed13-47b5-a4af-bf8c1d45a070 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:24.449024 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-245d204d-ed13-47b5-a4af-bf8c1d45a070 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:41:24.457068 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-245d204d-ed13-47b5-a4af-bf8c1d45a070 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:41:24.458556 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-245d204d-ed13-47b5-a4af-bf8c1d45a070 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:41:24.459674 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-245d204d-ed13-47b5-a4af-bf8c1d45a070 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 200 len: 1341 microversion: 2.20 time: 0.090368 Jun 30 12:41:24.460441 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 421/853] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:41:24 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 1341 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:41:25.478310 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-025fc1ed-fd84-4587-8c67-7010655597bd tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:41:25.478947 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-025fc1ed-fd84-4587-8c67-7010655597bd tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:41:25.485800 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-025fc1ed-fd84-4587-8c67-7010655597bd tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:25.486285 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-025fc1ed-fd84-4587-8c67-7010655597bd tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:25.487061 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-025fc1ed-fd84-4587-8c67-7010655597bd tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:25.487489 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-025fc1ed-fd84-4587-8c67-7010655597bd tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:25.625614 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-025fc1ed-fd84-4587-8c67-7010655597bd tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:41:25.634550 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-025fc1ed-fd84-4587-8c67-7010655597bd tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:41:25.636050 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-025fc1ed-fd84-4587-8c67-7010655597bd tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:41:25.637217 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-025fc1ed-fd84-4587-8c67-7010655597bd tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 200 len: 1407 microversion: 2.20 time: 0.162988 Jun 30 12:41:25.638038 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 433/854] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:41:25 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:41:25.797397 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [req-be961b86-e040-4b2f-8b18-a12d83785026 req-450fa4bd-fb2b-4c4f-8f93-8cfa667bc2e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c79b3b73-522e-4636-bd99-234f910f3999", "tag": "89638ae7-46a1-4d58-af0e-071e8bafd6b4"}]} {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:41:25.808017 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [req-be961b86-e040-4b2f-8b18-a12d83785026 req-450fa4bd-fb2b-4c4f-8f93-8cfa667bc2e9 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:25.808490 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [req-be961b86-e040-4b2f-8b18-a12d83785026 req-450fa4bd-fb2b-4c4f-8f93-8cfa667bc2e9 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:25.827386 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.compute.server_external_events [req-be961b86-e040-4b2f-8b18-a12d83785026 req-450fa4bd-fb2b-4c4f-8f93-8cfa667bc2e9 service nova] Creating event network-changed:89638ae7-46a1-4d58-af0e-071e8bafd6b4 for instance c79b3b73-522e-4636-bd99-234f910f3999 on hv-cinder-84614 Jun 30 12:41:25.832555 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [req-be961b86-e040-4b2f-8b18-a12d83785026 req-450fa4bd-fb2b-4c4f-8f93-8cfa667bc2e9 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038764 Jun 30 12:41:25.833286 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 422/855] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 30 12:41:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:41:26.660861 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-54144574-74f0-46d2-89c5-d1a8a5b130cc tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:41:26.661943 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-54144574-74f0-46d2-89c5-d1a8a5b130cc tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:41:26.673113 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-54144574-74f0-46d2-89c5-d1a8a5b130cc tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:26.673905 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-54144574-74f0-46d2-89c5-d1a8a5b130cc tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:26.675239 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-54144574-74f0-46d2-89c5-d1a8a5b130cc tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:26.675959 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-54144574-74f0-46d2-89c5-d1a8a5b130cc tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:26.818281 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-54144574-74f0-46d2-89c5-d1a8a5b130cc tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:41:26.830403 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-54144574-74f0-46d2-89c5-d1a8a5b130cc tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:41:26.832777 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-54144574-74f0-46d2-89c5-d1a8a5b130cc tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:41:26.834473 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-54144574-74f0-46d2-89c5-d1a8a5b130cc tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 200 len: 1407 microversion: 2.20 time: 0.180043 Jun 30 12:41:26.835218 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 434/856] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:41:26 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 1407 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:41:27.857638 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-b8e49189-2be1-4e5c-91c7-a61e54590bda tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:41:27.858330 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-b8e49189-2be1-4e5c-91c7-a61e54590bda tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:41:27.865019 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-b8e49189-2be1-4e5c-91c7-a61e54590bda tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:27.865460 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-b8e49189-2be1-4e5c-91c7-a61e54590bda tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:27.866404 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-b8e49189-2be1-4e5c-91c7-a61e54590bda tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:27.866834 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-b8e49189-2be1-4e5c-91c7-a61e54590bda tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:28.004267 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-b8e49189-2be1-4e5c-91c7-a61e54590bda tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:41:28.013067 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-b8e49189-2be1-4e5c-91c7-a61e54590bda tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:41:28.014616 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-b8e49189-2be1-4e5c-91c7-a61e54590bda tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:41:28.015724 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-b8e49189-2be1-4e5c-91c7-a61e54590bda tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 200 len: 1407 microversion: 2.20 time: 0.165267 Jun 30 12:41:28.016270 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 423/857] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:41:27 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:41:29.036219 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-94b9357e-f3fb-4e52-9f56-c3156123eea6 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:41:29.036931 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-94b9357e-f3fb-4e52-9f56-c3156123eea6 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:41:29.046259 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-94b9357e-f3fb-4e52-9f56-c3156123eea6 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:29.046709 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-94b9357e-f3fb-4e52-9f56-c3156123eea6 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:29.047673 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-94b9357e-f3fb-4e52-9f56-c3156123eea6 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:29.048102 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-94b9357e-f3fb-4e52-9f56-c3156123eea6 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:29.191195 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-94b9357e-f3fb-4e52-9f56-c3156123eea6 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:41:29.199901 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-94b9357e-f3fb-4e52-9f56-c3156123eea6 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:41:29.201421 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-94b9357e-f3fb-4e52-9f56-c3156123eea6 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:41:29.202531 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-94b9357e-f3fb-4e52-9f56-c3156123eea6 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 200 len: 1407 microversion: 2.20 time: 0.172211 Jun 30 12:41:29.203423 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 435/858] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:41:29 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 1407 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:41:30.221638 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-8764cec1-867e-4858-92e8-41ed8e969a78 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:41:30.222243 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-8764cec1-867e-4858-92e8-41ed8e969a78 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:41:30.229893 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-8764cec1-867e-4858-92e8-41ed8e969a78 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:30.230353 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-8764cec1-867e-4858-92e8-41ed8e969a78 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:30.231144 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-8764cec1-867e-4858-92e8-41ed8e969a78 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:30.231569 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-8764cec1-867e-4858-92e8-41ed8e969a78 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:30.385368 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-8764cec1-867e-4858-92e8-41ed8e969a78 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:41:30.388558 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG dbcounter [-] [124298] Writing DB stats nova_cell1:SELECT=100 {{(pid=124298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:41:30.398692 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-8764cec1-867e-4858-92e8-41ed8e969a78 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:41:30.401036 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-8764cec1-867e-4858-92e8-41ed8e969a78 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:41:30.402659 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-8764cec1-867e-4858-92e8-41ed8e969a78 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 200 len: 1407 microversion: 2.20 time: 0.185069 Jun 30 12:41:30.403210 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 424/859] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:41:30 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 1407 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:41:31.356667 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [req-bb1dac9b-ba67-4030-8648-88fa7b61a50a req-27c40baf-fe2f-4d66-ac1e-1682c5f78920 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c79b3b73-522e-4636-bd99-234f910f3999", "name": "network-vif-plugged", "status": "completed", "tag": "89638ae7-46a1-4d58-af0e-071e8bafd6b4"}]} {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:41:31.372676 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [req-bb1dac9b-ba67-4030-8648-88fa7b61a50a req-27c40baf-fe2f-4d66-ac1e-1682c5f78920 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:31.373136 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [req-bb1dac9b-ba67-4030-8648-88fa7b61a50a req-27c40baf-fe2f-4d66-ac1e-1682c5f78920 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:31.387903 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.compute.server_external_events [req-bb1dac9b-ba67-4030-8648-88fa7b61a50a req-27c40baf-fe2f-4d66-ac1e-1682c5f78920 service nova] Creating event network-vif-plugged:89638ae7-46a1-4d58-af0e-071e8bafd6b4 for instance c79b3b73-522e-4636-bd99-234f910f3999 on hv-cinder-84614 Jun 30 12:41:31.394726 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [req-bb1dac9b-ba67-4030-8648-88fa7b61a50a req-27c40baf-fe2f-4d66-ac1e-1682c5f78920 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044697 Jun 30 12:41:31.395559 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 436/860] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 30 12:41:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:41:31.422506 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-70ac98a4-93bb-42c4-bdf9-fd2cdca97d37 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:41:31.423151 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-70ac98a4-93bb-42c4-bdf9-fd2cdca97d37 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:41:31.431997 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-70ac98a4-93bb-42c4-bdf9-fd2cdca97d37 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:31.432729 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-70ac98a4-93bb-42c4-bdf9-fd2cdca97d37 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:31.433480 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-70ac98a4-93bb-42c4-bdf9-fd2cdca97d37 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:31.433929 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-70ac98a4-93bb-42c4-bdf9-fd2cdca97d37 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:31.563769 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-70ac98a4-93bb-42c4-bdf9-fd2cdca97d37 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:41:31.572721 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-70ac98a4-93bb-42c4-bdf9-fd2cdca97d37 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:41:31.574341 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-70ac98a4-93bb-42c4-bdf9-fd2cdca97d37 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:41:31.575475 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-70ac98a4-93bb-42c4-bdf9-fd2cdca97d37 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 200 len: 1407 microversion: 2.20 time: 0.158557 Jun 30 12:41:31.576047 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 425/861] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:41:31 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:41:32.595650 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-4a3772ea-9493-44cb-ade7-84daba327722 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:41:32.596448 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-4a3772ea-9493-44cb-ade7-84daba327722 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:41:32.604670 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-4a3772ea-9493-44cb-ade7-84daba327722 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:32.605206 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-4a3772ea-9493-44cb-ade7-84daba327722 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:32.606093 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-4a3772ea-9493-44cb-ade7-84daba327722 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:32.606604 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-4a3772ea-9493-44cb-ade7-84daba327722 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:32.754747 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-4a3772ea-9493-44cb-ade7-84daba327722 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:41:32.767182 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-4a3772ea-9493-44cb-ade7-84daba327722 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:41:32.768677 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-4a3772ea-9493-44cb-ade7-84daba327722 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:41:32.769815 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-4a3772ea-9493-44cb-ade7-84daba327722 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 200 len: 1407 microversion: 2.20 time: 0.179216 Jun 30 12:41:32.770347 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 437/862] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:41:32 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 1407 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:41:33.793004 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-724926f3-ab52-466c-a45f-81bc3867d6bc tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:41:33.793614 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-724926f3-ab52-466c-a45f-81bc3867d6bc tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:41:33.795984 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG dbcounter [-] [124298] Writing DB stats nova_cell0:SELECT=2 {{(pid=124298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:41:33.796662 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG dbcounter [-] [124298] Writing DB stats nova_cell0:SELECT=6 {{(pid=124298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:41:33.803272 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-724926f3-ab52-466c-a45f-81bc3867d6bc tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:33.803718 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-724926f3-ab52-466c-a45f-81bc3867d6bc tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:33.804490 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-724926f3-ab52-466c-a45f-81bc3867d6bc tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:33.804964 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-724926f3-ab52-466c-a45f-81bc3867d6bc tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:33.941504 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-724926f3-ab52-466c-a45f-81bc3867d6bc tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:41:33.949749 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-724926f3-ab52-466c-a45f-81bc3867d6bc tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:41:33.951214 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-724926f3-ab52-466c-a45f-81bc3867d6bc tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:41:33.952362 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-724926f3-ab52-466c-a45f-81bc3867d6bc tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 200 len: 1598 microversion: 2.20 time: 0.166096 Jun 30 12:41:33.952958 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 426/863] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:41:33 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 1598 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:41:33.975609 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-7efdfd12-23d9-4270-8105-1049c506b155 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:41:33.976164 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-7efdfd12-23d9-4270-8105-1049c506b155 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:41:33.978103 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG dbcounter [-] [124297] Writing DB stats nova_cell0:SELECT=6 {{(pid=124297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:41:33.984170 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-7efdfd12-23d9-4270-8105-1049c506b155 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:33.984617 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-7efdfd12-23d9-4270-8105-1049c506b155 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:33.985405 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-7efdfd12-23d9-4270-8105-1049c506b155 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:33.985838 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-7efdfd12-23d9-4270-8105-1049c506b155 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:34.065737 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-7efdfd12-23d9-4270-8105-1049c506b155 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.094118 Jun 30 12:41:34.066347 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 438/864] 10.222.0.57 () {60 vars in 1315 bytes} [Thu Jun 30 12:41:33 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 30 12:41:35.006915 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [req-75a20bb3-698d-4890-94ce-0c36323ce127 req-f2a407c7-1762-4d03-b6d6-62c48cfacc27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c79b3b73-522e-4636-bd99-234f910f3999", "tag": "89638ae7-46a1-4d58-af0e-071e8bafd6b4"}]} {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:41:35.016545 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [req-75a20bb3-698d-4890-94ce-0c36323ce127 req-f2a407c7-1762-4d03-b6d6-62c48cfacc27 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:35.017174 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [req-75a20bb3-698d-4890-94ce-0c36323ce127 req-f2a407c7-1762-4d03-b6d6-62c48cfacc27 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:35.029526 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.compute.server_external_events [req-75a20bb3-698d-4890-94ce-0c36323ce127 req-f2a407c7-1762-4d03-b6d6-62c48cfacc27 service nova] Creating event network-changed:89638ae7-46a1-4d58-af0e-071e8bafd6b4 for instance c79b3b73-522e-4636-bd99-234f910f3999 on hv-cinder-84614 Jun 30 12:41:35.034684 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [req-75a20bb3-698d-4890-94ce-0c36323ce127 req-f2a407c7-1762-4d03-b6d6-62c48cfacc27 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031600 Jun 30 12:41:35.035318 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 427/865] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 30 12:41:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:41:42.336049 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-d5d50bec-e2e3-4af2-bc01-b340dcc298ae tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:41:42.337030 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-d5d50bec-e2e3-4af2-bc01-b340dcc298ae tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: ba748986-dc18-4e3c-98fd-f3f0a6a46e2e] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:41:42.339864 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG dbcounter [-] [124297] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:41:42.349269 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-d5d50bec-e2e3-4af2-bc01-b340dcc298ae tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:42.350019 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-d5d50bec-e2e3-4af2-bc01-b340dcc298ae tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:42.351757 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-d5d50bec-e2e3-4af2-bc01-b340dcc298ae tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:42.352473 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-d5d50bec-e2e3-4af2-bc01-b340dcc298ae tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:42.358691 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG dbcounter [-] [124297] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:41:42.380358 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-d5d50bec-e2e3-4af2-bc01-b340dcc298ae tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "GET /compute/v2.1/servers/ba748986-dc18-4e3c-98fd-f3f0a6a46e2e/ips" status: 200 len: 148 microversion: 2.1 time: 0.051711 Jun 30 12:41:42.380869 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 439/866] 10.222.0.57 () {58 vars in 1247 bytes} [Thu Jun 30 12:41:42 2022] GET /compute/v2.1/servers/ba748986-dc18-4e3c-98fd-f3f0a6a46e2e/ips => generated 148 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:41:42.392253 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-da232ccb-143f-46a5-8a36-8fac19d2f553 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "13da325f-2319-41c4-b7d3-15a42f5ce34b"}} {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:41:42.393445 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-da232ccb-143f-46a5-8a36-8fac19d2f553 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: ba748986-dc18-4e3c-98fd-f3f0a6a46e2e] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:41:42.396016 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG dbcounter [-] [124298] Writing DB stats nova_api:SELECT=50,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:41:42.402079 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-da232ccb-143f-46a5-8a36-8fac19d2f553 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:42.402523 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-da232ccb-143f-46a5-8a36-8fac19d2f553 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:42.403297 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-da232ccb-143f-46a5-8a36-8fac19d2f553 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:42.403922 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-da232ccb-143f-46a5-8a36-8fac19d2f553 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:42.487154 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.wsgi [None req-da232ccb-143f-46a5-8a36-8fac19d2f553 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] HTTP exception thrown: Invalid volume: volume 13da325f-2319-41c4-b7d3-15a42f5ce34b is already attached to instances: 2a572f38-474c-4395-a917-074c331a5cb7 Jun 30 12:41:42.488937 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-da232ccb-143f-46a5-8a36-8fac19d2f553 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Request method failure captured: Jun 30 12:41:42.488937 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: request: POST /compute/v2.1/servers/ba748986-dc18-4e3c-98fd-f3f0a6a46e2e/os-volume_attachments HTTP/1.1 Jun 30 12:41:42.488937 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Accept: application/json Jun 30 12:41:42.488937 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Accept-Encoding: identity Jun 30 12:41:42.488937 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Connection: close Jun 30 12:41:42.488937 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Content-Length: 74 Jun 30 12:41:42.488937 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Content-Type: application/json Jun 30 12:41:42.488937 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Host: 10.222.0.57 Jun 30 12:41:42.488937 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Openstack-System-Scope: None Jun 30 12:41:42.488937 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: User-Agent: python-urllib3/1.26.9 Jun 30 12:41:42.488937 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Auth-Token: gAAAAABivZmUr5nE4sldlZsaj95gPYoaAcBmGRBy3I0hmzGn3iQqv5ZAgj-BPoF3DR2aprIIyzc4pOztEbmcfd7zRGCrhNVOgSUbHkrARCCB7THaqy8PU7wn9dODyPqFpdlPJv1XzD49N3q7ykzG0OSF7WObsxYnk2T0E2GFDSZRVSwfbpGoHiI Jun 30 12:41:42.488937 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Domain-Id: None Jun 30 12:41:42.488937 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Domain-Name: None Jun 30 12:41:42.488937 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Identity-Status: Confirmed Jun 30 12:41:42.488937 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Is-Admin-Project: True Jun 30 12:41:42.488937 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Domain-Id: default Jun 30 12:41:42.488937 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Domain-Name: Default Jun 30 12:41:42.488937 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Id: 359201313a944a8fa9881ee6fdea67e2 Jun 30 12:41:42.488937 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Name: tempest-AttachVolumeNegativeTest-110304785 Jun 30 12:41:42.488937 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Role: member,reader Jun 30 12:41:42.488937 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Roles: member,reader Jun 30 12:41:42.490598 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/359201313a944a8fa9881ee6fdea67e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/359201313a944a8fa9881ee6fdea67e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_359201313a944a8fa9881ee6fdea67e2", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/359201313a944a8fa9881ee6fdea67e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 30 12:41:42.490598 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant: tempest-AttachVolumeNegativeTest-110304785 Jun 30 12:41:42.490598 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant-Id: 359201313a944a8fa9881ee6fdea67e2 Jun 30 12:41:42.490598 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-110304785 Jun 30 12:41:42.490598 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User: tempest-AttachVolumeNegativeTest-110304785-project Jun 30 12:41:42.490598 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Domain-Id: default Jun 30 12:41:42.490598 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Domain-Name: Default Jun 30 12:41:42.490598 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Id: e935f2637d124453947b3c78360567a5 Jun 30 12:41:42.490598 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Name: tempest-AttachVolumeNegativeTest-110304785-project Jun 30 12:41:42.490598 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Jun 30 12:41:42.490598 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: {"volumeAttachment": {"volumeId": "13da325f-2319-41c4-b7d3-15a42f5ce34b"}} Jun 30 12:41:42.490598 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: method: > Jun 30 12:41:42.491455 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: exception: Invalid volume: volume 13da325f-2319-41c4-b7d3-15a42f5ce34b is already attached to instances: 2a572f38-474c-4395-a917-074c331a5cb7 Jun 30 12:41:42.491455 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: action_args: {'server_id': 'ba748986-dc18-4e3c-98fd-f3f0a6a46e2e', 'body': {'volumeAttachment': {'volumeId': '13da325f-2319-41c4-b7d3-15a42f5ce34b'}}} Jun 30 12:41:42.491455 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 12:41:42.491455 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:41:42.491455 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 30 12:41:42.491455 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 30 12:41:42.491455 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 30 12:41:42.491455 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 30 12:41:42.491455 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 30 12:41:42.491455 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 30 12:41:42.491455 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 30 12:41:42.491455 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 30 12:41:42.491455 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 30 12:41:42.491455 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 30 12:41:42.491455 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 13da325f-2319-41c4-b7d3-15a42f5ce34b is already attached to instances: 2a572f38-474c-4395-a917-074c331a5cb7 Jun 30 12:41:42.491455 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:41:42.491455 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:41:42.491455 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:41:42.491455 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:41:42.492774 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:41:42.492774 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:41:42.492774 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 12:41:42.492774 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 12:41:42.492774 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 12:41:42.492774 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 12:41:42.492774 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 30 12:41:42.492774 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 30 12:41:42.492774 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 30 12:41:42.492774 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 30 12:41:42.492774 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 30 12:41:42.492774 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 30 12:41:42.492774 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 30 12:41:42.492774 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 30 12:41:42.492774 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 13da325f-2319-41c4-b7d3-15a42f5ce34b is already attached to instances: 2a572f38-474c-4395-a917-074c331a5cb7 Jun 30 12:41:42.492774 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:41:42.492774 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:41:42.492774 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:41:42.492774 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:41:42.492774 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:41:42.494189 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:41:42.494189 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 12:41:42.494189 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 12:41:42.494189 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 13da325f-2319-41c4-b7d3-15a42f5ce34b is already attached to instances: 2a572f38-474c-4395-a917-074c331a5cb7 Jun 30 12:41:42.494189 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:41:42.494189 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-da232ccb-143f-46a5-8a36-8fac19d2f553 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Returning 400 to user: Invalid volume: volume 13da325f-2319-41c4-b7d3-15a42f5ce34b is already attached to instances: 2a572f38-474c-4395-a917-074c331a5cb7 {{(pid=124298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 12:41:42.494189 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-da232ccb-143f-46a5-8a36-8fac19d2f553 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "POST /compute/v2.1/servers/ba748986-dc18-4e3c-98fd-f3f0a6a46e2e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.102720 Jun 30 12:41:42.494189 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 428/867] 10.222.0.57 () {60 vars in 1322 bytes} [Thu Jun 30 12:41:42 2022] POST /compute/v2.1/servers/ba748986-dc18-4e3c-98fd-f3f0a6a46e2e/os-volume_attachments => generated 174 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 30 12:41:42.499828 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-23b43fb6-826f-433e-a023-b9f2bbbf3002 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:41:42.500321 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-23b43fb6-826f-433e-a023-b9f2bbbf3002 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: ba748986-dc18-4e3c-98fd-f3f0a6a46e2e] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:41:42.507151 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-23b43fb6-826f-433e-a023-b9f2bbbf3002 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:42.507594 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-23b43fb6-826f-433e-a023-b9f2bbbf3002 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:42.508356 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-23b43fb6-826f-433e-a023-b9f2bbbf3002 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:42.508834 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-23b43fb6-826f-433e-a023-b9f2bbbf3002 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:42.535506 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-23b43fb6-826f-433e-a023-b9f2bbbf3002 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: ba748986-dc18-4e3c-98fd-f3f0a6a46e2e] Going to try to terminate instance {{(pid=124297) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 12:41:42.631921 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-23b43fb6-826f-433e-a023-b9f2bbbf3002 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "DELETE /compute/v2.1/servers/ba748986-dc18-4e3c-98fd-f3f0a6a46e2e" status: 204 len: 0 microversion: 2.1 time: 0.136213 Jun 30 12:41:42.632429 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 440/868] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 30 12:41:42 2022] DELETE /compute/v2.1/servers/ba748986-dc18-4e3c-98fd-f3f0a6a46e2e => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 12:41:42.641042 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-87f2684b-24fc-4bb3-8968-6440bb62860e tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:41:42.641652 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-87f2684b-24fc-4bb3-8968-6440bb62860e tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: ba748986-dc18-4e3c-98fd-f3f0a6a46e2e] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:41:42.648599 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-87f2684b-24fc-4bb3-8968-6440bb62860e tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:42.649106 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-87f2684b-24fc-4bb3-8968-6440bb62860e tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:42.649868 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-87f2684b-24fc-4bb3-8968-6440bb62860e tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:42.650305 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-87f2684b-24fc-4bb3-8968-6440bb62860e tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:42.783123 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-87f2684b-24fc-4bb3-8968-6440bb62860e tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e935f2637d124453947b3c78360567a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359201313a944a8fa9881ee6fdea67e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:41:42.791561 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-87f2684b-24fc-4bb3-8968-6440bb62860e tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "GET /compute/v2.1/servers/ba748986-dc18-4e3c-98fd-f3f0a6a46e2e" status: 200 len: 1680 microversion: 2.1 time: 0.154752 Jun 30 12:41:42.792133 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 429/869] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:41:42 2022] GET /compute/v2.1/servers/ba748986-dc18-4e3c-98fd-f3f0a6a46e2e => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 12:41:43.819812 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-2fed1b74-ee7d-44e1-a3d7-15bc2c6bec52 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:41:43.820952 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-2fed1b74-ee7d-44e1-a3d7-15bc2c6bec52 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: ba748986-dc18-4e3c-98fd-f3f0a6a46e2e] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:41:43.830431 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-2fed1b74-ee7d-44e1-a3d7-15bc2c6bec52 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:43.830916 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-2fed1b74-ee7d-44e1-a3d7-15bc2c6bec52 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:43.831691 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-2fed1b74-ee7d-44e1-a3d7-15bc2c6bec52 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:43.832123 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-2fed1b74-ee7d-44e1-a3d7-15bc2c6bec52 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:43.972229 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-2fed1b74-ee7d-44e1-a3d7-15bc2c6bec52 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e935f2637d124453947b3c78360567a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359201313a944a8fa9881ee6fdea67e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:41:43.984245 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-2fed1b74-ee7d-44e1-a3d7-15bc2c6bec52 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "GET /compute/v2.1/servers/ba748986-dc18-4e3c-98fd-f3f0a6a46e2e" status: 200 len: 1680 microversion: 2.1 time: 0.171775 Jun 30 12:41:43.984891 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 441/870] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:41:43 2022] GET /compute/v2.1/servers/ba748986-dc18-4e3c-98fd-f3f0a6a46e2e => generated 1680 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:41:45.002397 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-b22dae74-d9df-48a1-9bb9-b4986ae4971b tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:41:45.003152 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-b22dae74-d9df-48a1-9bb9-b4986ae4971b tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: ba748986-dc18-4e3c-98fd-f3f0a6a46e2e] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:41:45.010355 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-b22dae74-d9df-48a1-9bb9-b4986ae4971b tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:45.010806 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-b22dae74-d9df-48a1-9bb9-b4986ae4971b tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:45.011563 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-b22dae74-d9df-48a1-9bb9-b4986ae4971b tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:45.012008 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-b22dae74-d9df-48a1-9bb9-b4986ae4971b tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:45.076803 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-b22dae74-d9df-48a1-9bb9-b4986ae4971b tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e935f2637d124453947b3c78360567a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359201313a944a8fa9881ee6fdea67e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:41:45.084908 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-b22dae74-d9df-48a1-9bb9-b4986ae4971b tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "GET /compute/v2.1/servers/ba748986-dc18-4e3c-98fd-f3f0a6a46e2e" status: 200 len: 1613 microversion: 2.1 time: 0.087019 Jun 30 12:41:45.094350 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 430/871] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:41:44 2022] GET /compute/v2.1/servers/ba748986-dc18-4e3c-98fd-f3f0a6a46e2e => generated 1613 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:41:45.251473 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [req-5ddded16-9b3a-4c2c-a0ef-579c31415534 req-1e8e80a0-b3ee-4657-b647-c2834b16041e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba748986-dc18-4e3c-98fd-f3f0a6a46e2e", "name": "network-vif-deleted", "tag": "d9729688-4600-45ad-a9ec-544e2a25a91a"}]} {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:41:45.260743 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [req-5ddded16-9b3a-4c2c-a0ef-579c31415534 req-1e8e80a0-b3ee-4657-b647-c2834b16041e service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:45.261234 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [req-5ddded16-9b3a-4c2c-a0ef-579c31415534 req-1e8e80a0-b3ee-4657-b647-c2834b16041e service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:45.273036 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.compute.server_external_events [req-5ddded16-9b3a-4c2c-a0ef-579c31415534 req-1e8e80a0-b3ee-4657-b647-c2834b16041e service nova] Creating event network-vif-deleted:d9729688-4600-45ad-a9ec-544e2a25a91a for instance ba748986-dc18-4e3c-98fd-f3f0a6a46e2e on hv-cinder-84614 Jun 30 12:41:45.278431 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [req-5ddded16-9b3a-4c2c-a0ef-579c31415534 req-1e8e80a0-b3ee-4657-b647-c2834b16041e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030920 Jun 30 12:41:45.279385 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 442/872] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 30 12:41:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:41:46.102985 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-49c56890-24ef-4fc2-adc2-f62381359a03 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:41:46.103575 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-49c56890-24ef-4fc2-adc2-f62381359a03 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: ba748986-dc18-4e3c-98fd-f3f0a6a46e2e] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:41:46.111066 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-49c56890-24ef-4fc2-adc2-f62381359a03 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:46.111508 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-49c56890-24ef-4fc2-adc2-f62381359a03 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:46.112270 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-49c56890-24ef-4fc2-adc2-f62381359a03 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:46.112706 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-49c56890-24ef-4fc2-adc2-f62381359a03 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:46.127379 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.wsgi [None req-49c56890-24ef-4fc2-adc2-f62381359a03 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] HTTP exception thrown: Instance ba748986-dc18-4e3c-98fd-f3f0a6a46e2e could not be found. Jun 30 12:41:46.129001 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-49c56890-24ef-4fc2-adc2-f62381359a03 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Request method failure captured: Jun 30 12:41:46.129001 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: request: GET /compute/v2.1/servers/ba748986-dc18-4e3c-98fd-f3f0a6a46e2e HTTP/1.1 Jun 30 12:41:46.129001 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Accept: application/json Jun 30 12:41:46.129001 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Accept-Encoding: identity Jun 30 12:41:46.129001 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Connection: close Jun 30 12:41:46.129001 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Content-Length: 0 Jun 30 12:41:46.129001 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Content-Type: application/json Jun 30 12:41:46.129001 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Host: 10.222.0.57 Jun 30 12:41:46.129001 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Openstack-System-Scope: None Jun 30 12:41:46.129001 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: User-Agent: python-urllib3/1.26.9 Jun 30 12:41:46.129001 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Auth-Token: gAAAAABivZmUr5nE4sldlZsaj95gPYoaAcBmGRBy3I0hmzGn3iQqv5ZAgj-BPoF3DR2aprIIyzc4pOztEbmcfd7zRGCrhNVOgSUbHkrARCCB7THaqy8PU7wn9dODyPqFpdlPJv1XzD49N3q7ykzG0OSF7WObsxYnk2T0E2GFDSZRVSwfbpGoHiI Jun 30 12:41:46.129001 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Domain-Id: None Jun 30 12:41:46.129001 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Domain-Name: None Jun 30 12:41:46.129001 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Identity-Status: Confirmed Jun 30 12:41:46.129001 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Is-Admin-Project: True Jun 30 12:41:46.129001 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Domain-Id: default Jun 30 12:41:46.129001 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Domain-Name: Default Jun 30 12:41:46.129001 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Id: 359201313a944a8fa9881ee6fdea67e2 Jun 30 12:41:46.129001 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Name: tempest-AttachVolumeNegativeTest-110304785 Jun 30 12:41:46.129001 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Role: member,reader Jun 30 12:41:46.129001 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Roles: member,reader Jun 30 12:41:46.130472 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/359201313a944a8fa9881ee6fdea67e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/359201313a944a8fa9881ee6fdea67e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_359201313a944a8fa9881ee6fdea67e2", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/359201313a944a8fa9881ee6fdea67e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 30 12:41:46.130472 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant: tempest-AttachVolumeNegativeTest-110304785 Jun 30 12:41:46.130472 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant-Id: 359201313a944a8fa9881ee6fdea67e2 Jun 30 12:41:46.130472 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-110304785 Jun 30 12:41:46.130472 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User: tempest-AttachVolumeNegativeTest-110304785-project Jun 30 12:41:46.130472 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Domain-Id: default Jun 30 12:41:46.130472 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Domain-Name: Default Jun 30 12:41:46.130472 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Id: e935f2637d124453947b3c78360567a5 Jun 30 12:41:46.130472 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Name: tempest-AttachVolumeNegativeTest-110304785-project Jun 30 12:41:46.130472 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: method: > Jun 30 12:41:46.130472 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: exception: Instance ba748986-dc18-4e3c-98fd-f3f0a6a46e2e could not be found. Jun 30 12:41:46.130472 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: action_args: {'id': 'ba748986-dc18-4e3c-98fd-f3f0a6a46e2e'} Jun 30 12:41:46.131335 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 12:41:46.131335 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:41:46.131335 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 12:41:46.131335 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 12:41:46.131335 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 12:41:46.131335 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 12:41:46.131335 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 12:41:46.131335 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 12:41:46.131335 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 12:41:46.131335 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 12:41:46.131335 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba748986-dc18-4e3c-98fd-f3f0a6a46e2e could not be found. Jun 30 12:41:46.131335 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:41:46.131335 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:41:46.131335 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:41:46.131335 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:41:46.131335 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:41:46.131335 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:41:46.131335 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 12:41:46.131335 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 12:41:46.131335 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 12:41:46.132824 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 12:41:46.132824 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 12:41:46.132824 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 12:41:46.132824 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 12:41:46.132824 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 12:41:46.132824 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 12:41:46.132824 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 12:41:46.132824 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba748986-dc18-4e3c-98fd-f3f0a6a46e2e could not be found. Jun 30 12:41:46.132824 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:41:46.132824 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:41:46.132824 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:41:46.132824 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:41:46.132824 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:41:46.132824 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:41:46.132824 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 12:41:46.132824 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 12:41:46.132824 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba748986-dc18-4e3c-98fd-f3f0a6a46e2e could not be found. Jun 30 12:41:46.132824 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:41:46.134044 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-49c56890-24ef-4fc2-adc2-f62381359a03 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Returning 404 to user: Instance ba748986-dc18-4e3c-98fd-f3f0a6a46e2e could not be found. {{(pid=124298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 12:41:46.134044 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-49c56890-24ef-4fc2-adc2-f62381359a03 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "GET /compute/v2.1/servers/ba748986-dc18-4e3c-98fd-f3f0a6a46e2e" status: 404 len: 111 microversion: 2.1 time: 0.032649 Jun 30 12:41:46.134044 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 431/873] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:41:46 2022] GET /compute/v2.1/servers/ba748986-dc18-4e3c-98fd-f3f0a6a46e2e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 12:41:46.143010 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-8e075819-d7eb-4e31-b4b9-111962a63f7a tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Calling method '.version_select at 0x7fd0daf99ee0>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:41:46.165037 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-8e075819-d7eb-4e31-b4b9-111962a63f7a tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1199944920" status: 202 len: 0 microversion: 2.1 time: 0.026901 Jun 30 12:41:46.165630 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 443/874] 10.222.0.57 () {58 vars in 1220 bytes} [Thu Jun 30 12:41:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1199944920 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 12:41:46.876160 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-958febd2-e140-4bb2-9a5a-23d307ab3694 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:41:46.876657 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-958febd2-e140-4bb2-9a5a-23d307ab3694 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: 2a572f38-474c-4395-a917-074c331a5cb7] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:41:46.883167 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-958febd2-e140-4bb2-9a5a-23d307ab3694 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:46.883607 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-958febd2-e140-4bb2-9a5a-23d307ab3694 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:46.884356 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-958febd2-e140-4bb2-9a5a-23d307ab3694 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:46.884822 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-958febd2-e140-4bb2-9a5a-23d307ab3694 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:46.981964 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.objects.instance [None req-958febd2-e140-4bb2-9a5a-23d307ab3694 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lazy-loading 'services' on Instance uuid 2a572f38-474c-4395-a917-074c331a5cb7 {{(pid=124298) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 12:41:47.058307 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-958febd2-e140-4bb2-9a5a-23d307ab3694 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "DELETE /compute/v2.1/servers/2a572f38-474c-4395-a917-074c331a5cb7/os-volume_attachments/13da325f-2319-41c4-b7d3-15a42f5ce34b" status: 202 len: 0 microversion: 2.1 time: 0.186049 Jun 30 12:41:47.058879 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 432/875] 10.222.0.57 () {58 vars in 1415 bytes} [Thu Jun 30 12:41:46 2022] DELETE /compute/v2.1/servers/2a572f38-474c-4395-a917-074c331a5cb7/os-volume_attachments/13da325f-2319-41c4-b7d3-15a42f5ce34b => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 12:41:47.067514 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-2010265e-832b-49e2-a381-bf3b1d741ac7 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:41:47.068754 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-2010265e-832b-49e2-a381-bf3b1d741ac7 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: 2a572f38-474c-4395-a917-074c331a5cb7] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:41:47.075902 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-2010265e-832b-49e2-a381-bf3b1d741ac7 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:47.076345 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-2010265e-832b-49e2-a381-bf3b1d741ac7 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:47.077453 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-2010265e-832b-49e2-a381-bf3b1d741ac7 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:47.078068 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-2010265e-832b-49e2-a381-bf3b1d741ac7 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:47.108044 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-2010265e-832b-49e2-a381-bf3b1d741ac7 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "GET /compute/v2.1/servers/2a572f38-474c-4395-a917-074c331a5cb7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044506 Jun 30 12:41:47.109069 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 444/876] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jun 30 12:41:47 2022] GET /compute/v2.1/servers/2a572f38-474c-4395-a917-074c331a5cb7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:41:48.120958 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-b1dba5fd-8d0f-4f06-b6f3-f75e8b8d9dbf tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:41:48.122019 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-b1dba5fd-8d0f-4f06-b6f3-f75e8b8d9dbf tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: 2a572f38-474c-4395-a917-074c331a5cb7] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:41:48.128949 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-b1dba5fd-8d0f-4f06-b6f3-f75e8b8d9dbf tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:48.129402 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-b1dba5fd-8d0f-4f06-b6f3-f75e8b8d9dbf tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:48.130207 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-b1dba5fd-8d0f-4f06-b6f3-f75e8b8d9dbf tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:48.130647 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-b1dba5fd-8d0f-4f06-b6f3-f75e8b8d9dbf tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:48.162734 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-b1dba5fd-8d0f-4f06-b6f3-f75e8b8d9dbf tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "GET /compute/v2.1/servers/2a572f38-474c-4395-a917-074c331a5cb7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046707 Jun 30 12:41:48.163289 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 433/877] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jun 30 12:41:48 2022] GET /compute/v2.1/servers/2a572f38-474c-4395-a917-074c331a5cb7/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 30 12:41:48.222972 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-23089886-5472-43c2-bc16-9b4782c2ce09 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:41:48.223509 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-23089886-5472-43c2-bc16-9b4782c2ce09 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: 2a572f38-474c-4395-a917-074c331a5cb7] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:41:48.230331 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-23089886-5472-43c2-bc16-9b4782c2ce09 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:48.230859 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-23089886-5472-43c2-bc16-9b4782c2ce09 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:48.231632 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-23089886-5472-43c2-bc16-9b4782c2ce09 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:48.232072 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-23089886-5472-43c2-bc16-9b4782c2ce09 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:48.259870 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-23089886-5472-43c2-bc16-9b4782c2ce09 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: 2a572f38-474c-4395-a917-074c331a5cb7] Going to try to terminate instance {{(pid=124297) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 12:41:48.519692 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-23089886-5472-43c2-bc16-9b4782c2ce09 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "DELETE /compute/v2.1/servers/2a572f38-474c-4395-a917-074c331a5cb7" status: 204 len: 0 microversion: 2.1 time: 0.300251 Jun 30 12:41:48.520236 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 445/878] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 30 12:41:48 2022] DELETE /compute/v2.1/servers/2a572f38-474c-4395-a917-074c331a5cb7 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 12:41:48.531112 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-23418ef8-3f22-4e1a-81fd-7bb379404f3c tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:41:48.531773 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-23418ef8-3f22-4e1a-81fd-7bb379404f3c tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: 2a572f38-474c-4395-a917-074c331a5cb7] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:41:48.537992 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-23418ef8-3f22-4e1a-81fd-7bb379404f3c tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:48.538438 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-23418ef8-3f22-4e1a-81fd-7bb379404f3c tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:48.539192 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-23418ef8-3f22-4e1a-81fd-7bb379404f3c tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:48.539624 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-23418ef8-3f22-4e1a-81fd-7bb379404f3c tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:48.690463 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-23418ef8-3f22-4e1a-81fd-7bb379404f3c tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e935f2637d124453947b3c78360567a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359201313a944a8fa9881ee6fdea67e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:41:48.698631 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-23418ef8-3f22-4e1a-81fd-7bb379404f3c tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "GET /compute/v2.1/servers/2a572f38-474c-4395-a917-074c331a5cb7" status: 200 len: 1681 microversion: 2.1 time: 0.171862 Jun 30 12:41:48.699599 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 434/879] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:41:48 2022] GET /compute/v2.1/servers/2a572f38-474c-4395-a917-074c331a5cb7 => generated 1681 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:41:49.725341 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-c4d1b8f3-c746-4ec8-abb3-56df99e2f19d tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:41:49.726527 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-c4d1b8f3-c746-4ec8-abb3-56df99e2f19d tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: 2a572f38-474c-4395-a917-074c331a5cb7] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:41:49.736855 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-c4d1b8f3-c746-4ec8-abb3-56df99e2f19d tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:49.737300 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-c4d1b8f3-c746-4ec8-abb3-56df99e2f19d tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:49.738110 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-c4d1b8f3-c746-4ec8-abb3-56df99e2f19d tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:49.738480 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-c4d1b8f3-c746-4ec8-abb3-56df99e2f19d tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:49.878021 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-c4d1b8f3-c746-4ec8-abb3-56df99e2f19d tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e935f2637d124453947b3c78360567a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359201313a944a8fa9881ee6fdea67e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:41:49.885777 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-c4d1b8f3-c746-4ec8-abb3-56df99e2f19d tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "GET /compute/v2.1/servers/2a572f38-474c-4395-a917-074c331a5cb7" status: 200 len: 1681 microversion: 2.1 time: 0.168470 Jun 30 12:41:49.886360 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 446/880] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:41:49 2022] GET /compute/v2.1/servers/2a572f38-474c-4395-a917-074c331a5cb7 => generated 1681 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:41:50.903940 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-6045a3c4-fc77-4f6d-81e6-ec3e5847f706 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:41:50.904525 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-6045a3c4-fc77-4f6d-81e6-ec3e5847f706 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: 2a572f38-474c-4395-a917-074c331a5cb7] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:41:50.911625 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-6045a3c4-fc77-4f6d-81e6-ec3e5847f706 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:50.912096 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-6045a3c4-fc77-4f6d-81e6-ec3e5847f706 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:50.912909 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-6045a3c4-fc77-4f6d-81e6-ec3e5847f706 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:50.913342 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-6045a3c4-fc77-4f6d-81e6-ec3e5847f706 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:51.052431 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-6045a3c4-fc77-4f6d-81e6-ec3e5847f706 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e935f2637d124453947b3c78360567a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359201313a944a8fa9881ee6fdea67e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:41:51.060363 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-6045a3c4-fc77-4f6d-81e6-ec3e5847f706 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "GET /compute/v2.1/servers/2a572f38-474c-4395-a917-074c331a5cb7" status: 200 len: 1681 microversion: 2.1 time: 0.160719 Jun 30 12:41:51.064066 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 435/881] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:41:50 2022] GET /compute/v2.1/servers/2a572f38-474c-4395-a917-074c331a5cb7 => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:41:51.339881 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [req-4c7b5eb1-85c2-49b2-a4fa-d11c3bfabbcb req-f90a7656-5253-4fd3-8922-efe815a3cbec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a572f38-474c-4395-a917-074c331a5cb7", "name": "network-vif-deleted", "tag": "ce1f7c34-caf7-484b-a606-a9941e441752"}]} {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:41:51.349548 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [req-4c7b5eb1-85c2-49b2-a4fa-d11c3bfabbcb req-f90a7656-5253-4fd3-8922-efe815a3cbec service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:51.350066 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [req-4c7b5eb1-85c2-49b2-a4fa-d11c3bfabbcb req-f90a7656-5253-4fd3-8922-efe815a3cbec service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:51.361599 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.compute.server_external_events [req-4c7b5eb1-85c2-49b2-a4fa-d11c3bfabbcb req-f90a7656-5253-4fd3-8922-efe815a3cbec service nova] Creating event network-vif-deleted:ce1f7c34-caf7-484b-a606-a9941e441752 for instance 2a572f38-474c-4395-a917-074c331a5cb7 on hv-cinder-84614 Jun 30 12:41:51.367483 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [req-4c7b5eb1-85c2-49b2-a4fa-d11c3bfabbcb req-f90a7656-5253-4fd3-8922-efe815a3cbec service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030564 Jun 30 12:41:51.368442 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 447/882] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 30 12:41:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:41:52.079754 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-ad516a88-5410-447b-aa8a-100e9ca35ac8 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:41:52.080330 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-ad516a88-5410-447b-aa8a-100e9ca35ac8 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: 2a572f38-474c-4395-a917-074c331a5cb7] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:41:52.086943 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-ad516a88-5410-447b-aa8a-100e9ca35ac8 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:52.087421 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-ad516a88-5410-447b-aa8a-100e9ca35ac8 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:52.088183 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-ad516a88-5410-447b-aa8a-100e9ca35ac8 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:52.088619 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-ad516a88-5410-447b-aa8a-100e9ca35ac8 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:52.103254 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.wsgi [None req-ad516a88-5410-447b-aa8a-100e9ca35ac8 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] HTTP exception thrown: Instance 2a572f38-474c-4395-a917-074c331a5cb7 could not be found. Jun 30 12:41:52.104945 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-ad516a88-5410-447b-aa8a-100e9ca35ac8 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Request method failure captured: Jun 30 12:41:52.104945 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: request: GET /compute/v2.1/servers/2a572f38-474c-4395-a917-074c331a5cb7 HTTP/1.1 Jun 30 12:41:52.104945 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Accept: application/json Jun 30 12:41:52.104945 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Accept-Encoding: identity Jun 30 12:41:52.104945 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Connection: close Jun 30 12:41:52.104945 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Content-Length: 0 Jun 30 12:41:52.104945 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Content-Type: application/json Jun 30 12:41:52.104945 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Host: 10.222.0.57 Jun 30 12:41:52.104945 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Openstack-System-Scope: None Jun 30 12:41:52.104945 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: User-Agent: python-urllib3/1.26.9 Jun 30 12:41:52.104945 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Auth-Token: gAAAAABivZmUr5nE4sldlZsaj95gPYoaAcBmGRBy3I0hmzGn3iQqv5ZAgj-BPoF3DR2aprIIyzc4pOztEbmcfd7zRGCrhNVOgSUbHkrARCCB7THaqy8PU7wn9dODyPqFpdlPJv1XzD49N3q7ykzG0OSF7WObsxYnk2T0E2GFDSZRVSwfbpGoHiI Jun 30 12:41:52.104945 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Domain-Id: None Jun 30 12:41:52.104945 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Domain-Name: None Jun 30 12:41:52.104945 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Identity-Status: Confirmed Jun 30 12:41:52.104945 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Is-Admin-Project: True Jun 30 12:41:52.104945 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Domain-Id: default Jun 30 12:41:52.104945 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Domain-Name: Default Jun 30 12:41:52.104945 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Id: 359201313a944a8fa9881ee6fdea67e2 Jun 30 12:41:52.104945 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Name: tempest-AttachVolumeNegativeTest-110304785 Jun 30 12:41:52.104945 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Role: member,reader Jun 30 12:41:52.104945 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Roles: member,reader Jun 30 12:41:52.106400 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/359201313a944a8fa9881ee6fdea67e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/359201313a944a8fa9881ee6fdea67e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_359201313a944a8fa9881ee6fdea67e2", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/359201313a944a8fa9881ee6fdea67e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 30 12:41:52.106400 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant: tempest-AttachVolumeNegativeTest-110304785 Jun 30 12:41:52.106400 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant-Id: 359201313a944a8fa9881ee6fdea67e2 Jun 30 12:41:52.106400 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-110304785 Jun 30 12:41:52.106400 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User: tempest-AttachVolumeNegativeTest-110304785-project Jun 30 12:41:52.106400 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Domain-Id: default Jun 30 12:41:52.106400 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Domain-Name: Default Jun 30 12:41:52.106400 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Id: e935f2637d124453947b3c78360567a5 Jun 30 12:41:52.106400 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Name: tempest-AttachVolumeNegativeTest-110304785-project Jun 30 12:41:52.106400 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: method: > Jun 30 12:41:52.106400 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: exception: Instance 2a572f38-474c-4395-a917-074c331a5cb7 could not be found. Jun 30 12:41:52.106400 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: action_args: {'id': '2a572f38-474c-4395-a917-074c331a5cb7'} Jun 30 12:41:52.107622 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 12:41:52.107622 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:41:52.107622 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 12:41:52.107622 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 12:41:52.107622 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 12:41:52.107622 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 12:41:52.107622 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 12:41:52.107622 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 12:41:52.107622 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 12:41:52.107622 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 12:41:52.107622 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a572f38-474c-4395-a917-074c331a5cb7 could not be found. Jun 30 12:41:52.107622 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:41:52.107622 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:41:52.107622 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:41:52.107622 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:41:52.107622 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:41:52.107622 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:41:52.107622 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 12:41:52.107622 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 12:41:52.107622 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 12:41:52.108974 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 12:41:52.108974 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 12:41:52.108974 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 12:41:52.108974 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 12:41:52.108974 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 12:41:52.108974 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 12:41:52.108974 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 12:41:52.108974 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a572f38-474c-4395-a917-074c331a5cb7 could not be found. Jun 30 12:41:52.108974 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:41:52.108974 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:41:52.108974 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:41:52.108974 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:41:52.108974 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:41:52.108974 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:41:52.108974 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 12:41:52.108974 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 12:41:52.108974 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a572f38-474c-4395-a917-074c331a5cb7 could not be found. Jun 30 12:41:52.108974 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:41:52.110219 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-ad516a88-5410-447b-aa8a-100e9ca35ac8 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Returning 404 to user: Instance 2a572f38-474c-4395-a917-074c331a5cb7 could not be found. {{(pid=124298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 12:41:52.110219 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-ad516a88-5410-447b-aa8a-100e9ca35ac8 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "GET /compute/v2.1/servers/2a572f38-474c-4395-a917-074c331a5cb7" status: 404 len: 111 microversion: 2.1 time: 0.030855 Jun 30 12:41:52.110219 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 436/883] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:41:52 2022] GET /compute/v2.1/servers/2a572f38-474c-4395-a917-074c331a5cb7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 12:41:52.116809 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-9ef21a09-f9a0-4a3c-b73a-dd41c300b3ff tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Calling method '.version_select at 0x7fd0daf5e670>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:41:52.137096 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-9ef21a09-f9a0-4a3c-b73a-dd41c300b3ff tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1459956002" status: 202 len: 0 microversion: 2.1 time: 0.024445 Jun 30 12:41:52.137669 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 448/884] 10.222.0.57 () {58 vars in 1220 bytes} [Thu Jun 30 12:41:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1459956002 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 12:41:52.785312 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-650ba17b-fe6a-4c29-a7b5-225745590fc1 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Action: 'create', calling method: .version_select at 0x7fd0e009c430>, body: {"keypair": {"name": "tempest-keypair-1445727894", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPSFfmpt9FW2Xk1G7SIEq7ZXCnxLc1wGcV0ZLVF5ka/84XAMvgWKjdMe5gCafs3F/Cne0/QWD23zKo4c3/sYQ6yt5023BaRqKag8+ulAIQ4U06txeetfQpFrmm/fSl5Bcg=="}} {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:41:52.800114 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.quota [None req-650ba17b-fe6a-4c29-a7b5-225745590fc1 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Getting quotas for project 359201313a944a8fa9881ee6fdea67e2. Resources: {'key_pairs'} {{(pid=124298) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 12:41:52.803974 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.quota [None req-650ba17b-fe6a-4c29-a7b5-225745590fc1 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Getting quotas for user e935f2637d124453947b3c78360567a5 and project 359201313a944a8fa9881ee6fdea67e2. Resources: {'key_pairs'} {{(pid=124298) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 12:41:52.827844 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-650ba17b-fe6a-4c29-a7b5-225745590fc1 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047040 Jun 30 12:41:52.828481 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 437/885] 10.222.0.57 () {60 vars in 1158 bytes} [Thu Jun 30 12:41:52 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:41:54.454783 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-9b2b4a16-9ae3-4211-8775-a3a7fcbc6f7e tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2097053952", "imageRef": "776a1662-a241-4e20-9a9c-e4743c64efd0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0cf7ba00-1ef8-492b-b4f6-ee883e3dfe65"}], "security_groups": [{"name": "tempest-securitygroup--357922880"}], "key_name": "tempest-keypair-1445727894", "user_data": "}} {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:41:54.557999 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.network.neutron [None req-9b2b4a16-9ae3-4211-8775-a3a7fcbc6f7e tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] validate_networks() for [('0cf7ba00-1ef8-492b-b4f6-ee883e3dfe65', None, None, None, None, None)] {{(pid=124297) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 12:41:55.254842 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.virt.hardware [None req-9b2b4a16-9ae3-4211-8775-a3a7fcbc6f7e tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Flavor limits 0:0:0 {{(pid=124297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 12:41:55.255407 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.virt.hardware [None req-9b2b4a16-9ae3-4211-8775-a3a7fcbc6f7e tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Image limits 0:0:0 {{(pid=124297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 12:41:55.256089 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.virt.hardware [None req-9b2b4a16-9ae3-4211-8775-a3a7fcbc6f7e tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Flavor pref 0:0:0 {{(pid=124297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 12:41:55.256616 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.virt.hardware [None req-9b2b4a16-9ae3-4211-8775-a3a7fcbc6f7e tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Image pref 0:0:0 {{(pid=124297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 12:41:55.257215 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.virt.hardware [None req-9b2b4a16-9ae3-4211-8775-a3a7fcbc6f7e tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 12:41:55.272263 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-9b2b4a16-9ae3-4211-8775-a3a7fcbc6f7e tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:55.272840 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-9b2b4a16-9ae3-4211-8775-a3a7fcbc6f7e tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:55.274008 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-9b2b4a16-9ae3-4211-8775-a3a7fcbc6f7e tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:55.274572 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-9b2b4a16-9ae3-4211-8775-a3a7fcbc6f7e tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:55.294960 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.quota [None req-9b2b4a16-9ae3-4211-8775-a3a7fcbc6f7e tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Getting quotas for project 359201313a944a8fa9881ee6fdea67e2. Resources: {'cores', 'ram', 'instances'} {{(pid=124297) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 12:41:55.299368 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.quota [None req-9b2b4a16-9ae3-4211-8775-a3a7fcbc6f7e tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Getting quotas for user e935f2637d124453947b3c78360567a5 and project 359201313a944a8fa9881ee6fdea67e2. Resources: {'cores', 'ram', 'instances'} {{(pid=124297) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 12:41:55.310913 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-9b2b4a16-9ae3-4211-8775-a3a7fcbc6f7e tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Going to run 1 instances... {{(pid=124297) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 12:41:55.313721 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-9b2b4a16-9ae3-4211-8775-a3a7fcbc6f7e tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: 265d3404-34ac-4563-b1a8-f525c5b63888] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='776a1662-a241-4e20-9a9c-e4743c64efd0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124297) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 12:41:55.362208 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-9b2b4a16-9ae3-4211-8775-a3a7fcbc6f7e tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.912586 Jun 30 12:41:55.362852 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 449/886] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 30 12:41:54 2022] POST /compute/v2.1/servers => generated 401 bytes in 914 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 12:41:55.373792 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-de830952-b980-42ba-98a8-7a10ff80aee4 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:41:55.374640 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-de830952-b980-42ba-98a8-7a10ff80aee4 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: 265d3404-34ac-4563-b1a8-f525c5b63888] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:41:55.433050 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-de830952-b980-42ba-98a8-7a10ff80aee4 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e935f2637d124453947b3c78360567a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359201313a944a8fa9881ee6fdea67e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:41:55.441295 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-de830952-b980-42ba-98a8-7a10ff80aee4 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "GET /compute/v2.1/servers/265d3404-34ac-4563-b1a8-f525c5b63888" status: 200 len: 1242 microversion: 2.1 time: 0.071986 Jun 30 12:41:55.441817 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 438/887] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:41:55 2022] GET /compute/v2.1/servers/265d3404-34ac-4563-b1a8-f525c5b63888 => generated 1242 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:41:56.459076 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-f214757e-a7a2-4bb3-af2b-47266b8e2172 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:41:56.459725 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-f214757e-a7a2-4bb3-af2b-47266b8e2172 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: 265d3404-34ac-4563-b1a8-f525c5b63888] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:41:56.466485 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-f214757e-a7a2-4bb3-af2b-47266b8e2172 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:56.466936 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-f214757e-a7a2-4bb3-af2b-47266b8e2172 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:56.467715 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-f214757e-a7a2-4bb3-af2b-47266b8e2172 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:56.468273 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-f214757e-a7a2-4bb3-af2b-47266b8e2172 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:56.537153 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-f214757e-a7a2-4bb3-af2b-47266b8e2172 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e935f2637d124453947b3c78360567a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359201313a944a8fa9881ee6fdea67e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:41:56.544741 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-f214757e-a7a2-4bb3-af2b-47266b8e2172 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "GET /compute/v2.1/servers/265d3404-34ac-4563-b1a8-f525c5b63888" status: 200 len: 1294 microversion: 2.1 time: 0.090115 Jun 30 12:41:56.545551 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 450/888] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:41:56 2022] GET /compute/v2.1/servers/265d3404-34ac-4563-b1a8-f525c5b63888 => generated 1294 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:41:57.562151 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-bbaf4b81-fc44-474a-a40b-cc5c83453284 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:41:57.562766 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-bbaf4b81-fc44-474a-a40b-cc5c83453284 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: 265d3404-34ac-4563-b1a8-f525c5b63888] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:41:57.570158 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-bbaf4b81-fc44-474a-a40b-cc5c83453284 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:57.570712 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-bbaf4b81-fc44-474a-a40b-cc5c83453284 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:57.571578 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-bbaf4b81-fc44-474a-a40b-cc5c83453284 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:57.572079 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-bbaf4b81-fc44-474a-a40b-cc5c83453284 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:57.719778 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-bbaf4b81-fc44-474a-a40b-cc5c83453284 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e935f2637d124453947b3c78360567a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359201313a944a8fa9881ee6fdea67e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:41:57.727630 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-bbaf4b81-fc44-474a-a40b-cc5c83453284 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "GET /compute/v2.1/servers/265d3404-34ac-4563-b1a8-f525c5b63888" status: 200 len: 1367 microversion: 2.1 time: 0.169455 Jun 30 12:41:57.728224 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 439/889] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:41:57 2022] GET /compute/v2.1/servers/265d3404-34ac-4563-b1a8-f525c5b63888 => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:41:58.333659 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [req-22ea5cad-88ab-480a-9234-fc5968b49d29 req-03444b9f-6e3e-43f5-8305-ea8b04ff3cad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "265d3404-34ac-4563-b1a8-f525c5b63888", "tag": "07c1943e-c807-44db-b4e7-223826130edc"}]} {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:41:58.343976 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [req-22ea5cad-88ab-480a-9234-fc5968b49d29 req-03444b9f-6e3e-43f5-8305-ea8b04ff3cad service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:58.344554 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [req-22ea5cad-88ab-480a-9234-fc5968b49d29 req-03444b9f-6e3e-43f5-8305-ea8b04ff3cad service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:58.360013 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.compute.server_external_events [req-22ea5cad-88ab-480a-9234-fc5968b49d29 req-03444b9f-6e3e-43f5-8305-ea8b04ff3cad service nova] Creating event network-changed:07c1943e-c807-44db-b4e7-223826130edc for instance 265d3404-34ac-4563-b1a8-f525c5b63888 on hv-cinder-84614 Jun 30 12:41:58.365800 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [req-22ea5cad-88ab-480a-9234-fc5968b49d29 req-03444b9f-6e3e-43f5-8305-ea8b04ff3cad service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036174 Jun 30 12:41:58.366405 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 451/890] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 30 12:41:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:41:58.745091 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-458fe974-2793-4399-a9a8-f1d04d75f20f tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:41:58.745654 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-458fe974-2793-4399-a9a8-f1d04d75f20f tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: 265d3404-34ac-4563-b1a8-f525c5b63888] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:41:58.751871 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-458fe974-2793-4399-a9a8-f1d04d75f20f tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:58.752337 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-458fe974-2793-4399-a9a8-f1d04d75f20f tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:58.753158 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-458fe974-2793-4399-a9a8-f1d04d75f20f tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:58.753559 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-458fe974-2793-4399-a9a8-f1d04d75f20f tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:58.896034 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-458fe974-2793-4399-a9a8-f1d04d75f20f tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e935f2637d124453947b3c78360567a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359201313a944a8fa9881ee6fdea67e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:41:58.904251 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-458fe974-2793-4399-a9a8-f1d04d75f20f tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "GET /compute/v2.1/servers/265d3404-34ac-4563-b1a8-f525c5b63888" status: 200 len: 1367 microversion: 2.1 time: 0.163498 Jun 30 12:41:58.904858 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 440/891] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:41:58 2022] GET /compute/v2.1/servers/265d3404-34ac-4563-b1a8-f525c5b63888 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:41:59.922774 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-0bf13551-522d-4a70-862b-16e95bbb4216 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:41:59.923421 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-0bf13551-522d-4a70-862b-16e95bbb4216 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: 265d3404-34ac-4563-b1a8-f525c5b63888] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:41:59.930075 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-0bf13551-522d-4a70-862b-16e95bbb4216 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:59.930524 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-0bf13551-522d-4a70-862b-16e95bbb4216 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:41:59.931298 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-0bf13551-522d-4a70-862b-16e95bbb4216 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:41:59.931734 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-0bf13551-522d-4a70-862b-16e95bbb4216 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:00.065780 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-0bf13551-522d-4a70-862b-16e95bbb4216 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e935f2637d124453947b3c78360567a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359201313a944a8fa9881ee6fdea67e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:00.073532 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-0bf13551-522d-4a70-862b-16e95bbb4216 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "GET /compute/v2.1/servers/265d3404-34ac-4563-b1a8-f525c5b63888" status: 200 len: 1367 microversion: 2.1 time: 0.155781 Jun 30 12:42:00.083988 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 452/892] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:41:59 2022] GET /compute/v2.1/servers/265d3404-34ac-4563-b1a8-f525c5b63888 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:42:01.095848 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-52dfde23-e758-4b5d-9752-e69eea6553f7 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:42:01.096856 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-52dfde23-e758-4b5d-9752-e69eea6553f7 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: 265d3404-34ac-4563-b1a8-f525c5b63888] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:42:01.104068 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-52dfde23-e758-4b5d-9752-e69eea6553f7 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:01.104518 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-52dfde23-e758-4b5d-9752-e69eea6553f7 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:01.105311 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-52dfde23-e758-4b5d-9752-e69eea6553f7 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:01.105750 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-52dfde23-e758-4b5d-9752-e69eea6553f7 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:01.108466 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG dbcounter [-] [124298] Writing DB stats nova_cell1:SELECT=77,nova_cell1:INSERT=1 {{(pid=124298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:42:01.246316 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-52dfde23-e758-4b5d-9752-e69eea6553f7 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e935f2637d124453947b3c78360567a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359201313a944a8fa9881ee6fdea67e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:01.255336 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-52dfde23-e758-4b5d-9752-e69eea6553f7 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "GET /compute/v2.1/servers/265d3404-34ac-4563-b1a8-f525c5b63888" status: 200 len: 1367 microversion: 2.1 time: 0.166084 Jun 30 12:42:01.255915 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 441/893] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:42:01 2022] GET /compute/v2.1/servers/265d3404-34ac-4563-b1a8-f525c5b63888 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:42:02.276341 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-b7e653e4-cc3a-41a2-bc2a-21fff4988222 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:42:02.277297 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-b7e653e4-cc3a-41a2-bc2a-21fff4988222 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: 265d3404-34ac-4563-b1a8-f525c5b63888] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:42:02.289134 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-b7e653e4-cc3a-41a2-bc2a-21fff4988222 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:02.289874 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-b7e653e4-cc3a-41a2-bc2a-21fff4988222 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:02.291125 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-b7e653e4-cc3a-41a2-bc2a-21fff4988222 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:02.291831 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-b7e653e4-cc3a-41a2-bc2a-21fff4988222 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:02.434153 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-b7e653e4-cc3a-41a2-bc2a-21fff4988222 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e935f2637d124453947b3c78360567a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359201313a944a8fa9881ee6fdea67e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:02.446318 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-b7e653e4-cc3a-41a2-bc2a-21fff4988222 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "GET /compute/v2.1/servers/265d3404-34ac-4563-b1a8-f525c5b63888" status: 200 len: 1367 microversion: 2.1 time: 0.176735 Jun 30 12:42:02.447082 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 453/894] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:42:02 2022] GET /compute/v2.1/servers/265d3404-34ac-4563-b1a8-f525c5b63888 => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:42:03.464921 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-167c94d4-f839-4def-b98f-f6a5abf08178 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:42:03.465556 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-167c94d4-f839-4def-b98f-f6a5abf08178 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: 265d3404-34ac-4563-b1a8-f525c5b63888] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:42:03.473145 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-167c94d4-f839-4def-b98f-f6a5abf08178 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:03.473594 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-167c94d4-f839-4def-b98f-f6a5abf08178 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:03.474369 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-167c94d4-f839-4def-b98f-f6a5abf08178 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:03.474801 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-167c94d4-f839-4def-b98f-f6a5abf08178 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:03.490752 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [req-68435a6f-b357-4dfe-96a9-02195bce2c35 req-1b40b3f2-8783-4f70-8a0a-3dd7a98d3b64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "265d3404-34ac-4563-b1a8-f525c5b63888", "name": "network-vif-plugged", "status": "completed", "tag": "07c1943e-c807-44db-b4e7-223826130edc"}]} {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:42:03.501076 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [req-68435a6f-b357-4dfe-96a9-02195bce2c35 req-1b40b3f2-8783-4f70-8a0a-3dd7a98d3b64 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:03.501548 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [req-68435a6f-b357-4dfe-96a9-02195bce2c35 req-1b40b3f2-8783-4f70-8a0a-3dd7a98d3b64 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:03.513484 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.compute.server_external_events [req-68435a6f-b357-4dfe-96a9-02195bce2c35 req-1b40b3f2-8783-4f70-8a0a-3dd7a98d3b64 service nova] Creating event network-vif-plugged:07c1943e-c807-44db-b4e7-223826130edc for instance 265d3404-34ac-4563-b1a8-f525c5b63888 on hv-cinder-84614 Jun 30 12:42:03.519009 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [req-68435a6f-b357-4dfe-96a9-02195bce2c35 req-1b40b3f2-8783-4f70-8a0a-3dd7a98d3b64 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031967 Jun 30 12:42:03.520300 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 454/895] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 30 12:42:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 12:42:03.618684 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-167c94d4-f839-4def-b98f-f6a5abf08178 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e935f2637d124453947b3c78360567a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359201313a944a8fa9881ee6fdea67e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:03.627350 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-167c94d4-f839-4def-b98f-f6a5abf08178 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "GET /compute/v2.1/servers/265d3404-34ac-4563-b1a8-f525c5b63888" status: 200 len: 1367 microversion: 2.1 time: 0.166379 Jun 30 12:42:03.627969 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 442/896] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:42:03 2022] GET /compute/v2.1/servers/265d3404-34ac-4563-b1a8-f525c5b63888 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:42:04.646236 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-c4cfaa83-0039-4e55-a3c6-3733bc92fff8 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:42:04.646948 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-c4cfaa83-0039-4e55-a3c6-3733bc92fff8 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: 265d3404-34ac-4563-b1a8-f525c5b63888] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:42:04.654030 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-c4cfaa83-0039-4e55-a3c6-3733bc92fff8 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:04.654484 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-c4cfaa83-0039-4e55-a3c6-3733bc92fff8 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:04.655253 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-c4cfaa83-0039-4e55-a3c6-3733bc92fff8 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:04.655885 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-c4cfaa83-0039-4e55-a3c6-3733bc92fff8 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:04.795383 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-c4cfaa83-0039-4e55-a3c6-3733bc92fff8 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e935f2637d124453947b3c78360567a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359201313a944a8fa9881ee6fdea67e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:04.806853 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-c4cfaa83-0039-4e55-a3c6-3733bc92fff8 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "GET /compute/v2.1/servers/265d3404-34ac-4563-b1a8-f525c5b63888" status: 200 len: 1367 microversion: 2.1 time: 0.165077 Jun 30 12:42:04.807662 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 455/897] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:42:04 2022] GET /compute/v2.1/servers/265d3404-34ac-4563-b1a8-f525c5b63888 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:42:05.830061 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-ea4a3593-9ad2-4b58-9a61-8e3533fdefa4 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:42:05.830871 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-ea4a3593-9ad2-4b58-9a61-8e3533fdefa4 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: 265d3404-34ac-4563-b1a8-f525c5b63888] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:42:05.834623 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG dbcounter [-] [124298] Writing DB stats nova_cell0:SELECT=6 {{(pid=124298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:42:05.843885 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-ea4a3593-9ad2-4b58-9a61-8e3533fdefa4 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:05.844718 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-ea4a3593-9ad2-4b58-9a61-8e3533fdefa4 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:05.845618 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-ea4a3593-9ad2-4b58-9a61-8e3533fdefa4 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:05.846049 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-ea4a3593-9ad2-4b58-9a61-8e3533fdefa4 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:05.996274 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-ea4a3593-9ad2-4b58-9a61-8e3533fdefa4 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e935f2637d124453947b3c78360567a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359201313a944a8fa9881ee6fdea67e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:06.004574 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-ea4a3593-9ad2-4b58-9a61-8e3533fdefa4 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "GET /compute/v2.1/servers/265d3404-34ac-4563-b1a8-f525c5b63888" status: 200 len: 1556 microversion: 2.1 time: 0.181352 Jun 30 12:42:06.005182 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 443/898] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:42:05 2022] GET /compute/v2.1/servers/265d3404-34ac-4563-b1a8-f525c5b63888 => generated 1556 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:42:06.021304 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-05c390c3-2c0a-4003-8f13-afc069053e9a tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:42:06.021836 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-05c390c3-2c0a-4003-8f13-afc069053e9a tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: 265d3404-34ac-4563-b1a8-f525c5b63888] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:42:06.023640 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG dbcounter [-] [124297] Writing DB stats nova_cell0:SELECT=2 {{(pid=124297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:42:06.024326 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG dbcounter [-] [124297] Writing DB stats nova_cell0:SELECT=6 {{(pid=124297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:42:06.031140 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-05c390c3-2c0a-4003-8f13-afc069053e9a tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:06.031584 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-05c390c3-2c0a-4003-8f13-afc069053e9a tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:06.032379 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-05c390c3-2c0a-4003-8f13-afc069053e9a tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:06.032846 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-05c390c3-2c0a-4003-8f13-afc069053e9a tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:06.112482 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-05c390c3-2c0a-4003-8f13-afc069053e9a tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "GET /compute/v2.1/servers/265d3404-34ac-4563-b1a8-f525c5b63888/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095471 Jun 30 12:42:06.113131 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 456/899] 10.222.0.57 () {58 vars in 1274 bytes} [Thu Jun 30 12:42:06 2022] GET /compute/v2.1/servers/265d3404-34ac-4563-b1a8-f525c5b63888/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:42:07.070705 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [req-6a91f144-1684-490c-9227-58f826dfd3ca req-1aa0ce85-abea-4c88-8904-88203a34eec8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "265d3404-34ac-4563-b1a8-f525c5b63888", "tag": "07c1943e-c807-44db-b4e7-223826130edc"}]} {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:42:07.079390 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [req-6a91f144-1684-490c-9227-58f826dfd3ca req-1aa0ce85-abea-4c88-8904-88203a34eec8 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:07.079837 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [req-6a91f144-1684-490c-9227-58f826dfd3ca req-1aa0ce85-abea-4c88-8904-88203a34eec8 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:07.091065 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.compute.server_external_events [req-6a91f144-1684-490c-9227-58f826dfd3ca req-1aa0ce85-abea-4c88-8904-88203a34eec8 service nova] Creating event network-changed:07c1943e-c807-44db-b4e7-223826130edc for instance 265d3404-34ac-4563-b1a8-f525c5b63888 on hv-cinder-84614 Jun 30 12:42:07.096278 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [req-6a91f144-1684-490c-9227-58f826dfd3ca req-1aa0ce85-abea-4c88-8904-88203a34eec8 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029399 Jun 30 12:42:07.096997 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 444/900] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 30 12:42:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 12:42:11.142077 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-ef4953fd-48f7-4654-9711-37854092c4a1 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:42:11.142558 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-ef4953fd-48f7-4654-9711-37854092c4a1 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:42:11.149790 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-ef4953fd-48f7-4654-9711-37854092c4a1 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:11.150247 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-ef4953fd-48f7-4654-9711-37854092c4a1 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:11.151013 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-ef4953fd-48f7-4654-9711-37854092c4a1 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:11.151441 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-ef4953fd-48f7-4654-9711-37854092c4a1 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:11.175431 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-ef4953fd-48f7-4654-9711-37854092c4a1 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999/ips" status: 200 len: 151 microversion: 2.20 time: 0.037791 Jun 30 12:42:11.176307 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 457/901] 10.222.0.57 () {60 vars in 1288 bytes} [Thu Jun 30 12:42:11 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 12:42:13.755943 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-17e710d5-780a-49fd-bfbe-4ced5e974fbc tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:42:13.756512 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-17e710d5-780a-49fd-bfbe-4ced5e974fbc tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:42:13.758411 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG dbcounter [-] [124298] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=1 {{(pid=124298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:42:13.764233 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-17e710d5-780a-49fd-bfbe-4ced5e974fbc tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:13.764662 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-17e710d5-780a-49fd-bfbe-4ced5e974fbc tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:13.765456 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-17e710d5-780a-49fd-bfbe-4ced5e974fbc tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:13.765878 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-17e710d5-780a-49fd-bfbe-4ced5e974fbc tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:13.790917 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.objects.instance [None req-17e710d5-780a-49fd-bfbe-4ced5e974fbc tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lazy-loading 'flavor' on Instance uuid c79b3b73-522e-4636-bd99-234f910f3999 {{(pid=124298) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 12:42:14.068903 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-17e710d5-780a-49fd-bfbe-4ced5e974fbc tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "POST /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999/action" status: 202 len: 0 microversion: 2.20 time: 0.321137 Jun 30 12:42:14.069538 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 445/902] 10.222.0.57 () {62 vars in 1318 bytes} [Thu Jun 30 12:42:13 2022] POST /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999/action => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 30 12:42:14.077887 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-5086f1cc-67e5-49ba-a69c-6e40df3246d1 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:42:14.078501 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-5086f1cc-67e5-49ba-a69c-6e40df3246d1 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:42:14.081018 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG dbcounter [-] [124297] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=124297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:42:14.086115 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-5086f1cc-67e5-49ba-a69c-6e40df3246d1 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:14.086573 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-5086f1cc-67e5-49ba-a69c-6e40df3246d1 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:14.087353 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-5086f1cc-67e5-49ba-a69c-6e40df3246d1 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:14.087790 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-5086f1cc-67e5-49ba-a69c-6e40df3246d1 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:14.093627 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG dbcounter [-] [124297] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:42:14.234947 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-5086f1cc-67e5-49ba-a69c-6e40df3246d1 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:14.245080 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-5086f1cc-67e5-49ba-a69c-6e40df3246d1 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:14.246577 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-5086f1cc-67e5-49ba-a69c-6e40df3246d1 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:14.247749 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-5086f1cc-67e5-49ba-a69c-6e40df3246d1 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 200 len: 1723 microversion: 2.20 time: 0.173885 Jun 30 12:42:14.248314 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 458/903] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:42:14 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:42:15.273215 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-459bd07d-dd1b-42ce-94ee-256e7d2c687f tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:42:15.275328 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-459bd07d-dd1b-42ce-94ee-256e7d2c687f tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:42:15.286482 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-459bd07d-dd1b-42ce-94ee-256e7d2c687f tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:15.286941 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-459bd07d-dd1b-42ce-94ee-256e7d2c687f tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:15.287709 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-459bd07d-dd1b-42ce-94ee-256e7d2c687f tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:15.288147 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-459bd07d-dd1b-42ce-94ee-256e7d2c687f tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:15.448795 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-459bd07d-dd1b-42ce-94ee-256e7d2c687f tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:15.457495 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-459bd07d-dd1b-42ce-94ee-256e7d2c687f tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:15.465575 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-459bd07d-dd1b-42ce-94ee-256e7d2c687f tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:15.466772 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-459bd07d-dd1b-42ce-94ee-256e7d2c687f tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 200 len: 1723 microversion: 2.20 time: 0.202303 Jun 30 12:42:15.467348 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 446/904] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:42:15 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 1723 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:42:16.489773 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-fe02ce9d-cbe2-4be4-b345-80745b8df9f3 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:42:16.490381 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-fe02ce9d-cbe2-4be4-b345-80745b8df9f3 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:42:16.497732 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-fe02ce9d-cbe2-4be4-b345-80745b8df9f3 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:16.498188 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-fe02ce9d-cbe2-4be4-b345-80745b8df9f3 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:16.498964 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-fe02ce9d-cbe2-4be4-b345-80745b8df9f3 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:16.499401 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-fe02ce9d-cbe2-4be4-b345-80745b8df9f3 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:16.641968 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-fe02ce9d-cbe2-4be4-b345-80745b8df9f3 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:16.650839 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-fe02ce9d-cbe2-4be4-b345-80745b8df9f3 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:16.652330 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-fe02ce9d-cbe2-4be4-b345-80745b8df9f3 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:16.653540 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-fe02ce9d-cbe2-4be4-b345-80745b8df9f3 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 200 len: 1723 microversion: 2.20 time: 0.169480 Jun 30 12:42:16.654126 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 459/905] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:42:16 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:42:17.673170 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-cf5d761e-e892-492c-bee3-3f1754e7aec1 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:42:17.673784 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-cf5d761e-e892-492c-bee3-3f1754e7aec1 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:42:17.681037 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-cf5d761e-e892-492c-bee3-3f1754e7aec1 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:17.681485 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-cf5d761e-e892-492c-bee3-3f1754e7aec1 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:17.682249 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-cf5d761e-e892-492c-bee3-3f1754e7aec1 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:17.682683 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-cf5d761e-e892-492c-bee3-3f1754e7aec1 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:17.871752 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-cf5d761e-e892-492c-bee3-3f1754e7aec1 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:17.882681 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-cf5d761e-e892-492c-bee3-3f1754e7aec1 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:17.883514 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-cf5d761e-e892-492c-bee3-3f1754e7aec1 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:17.884782 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-cf5d761e-e892-492c-bee3-3f1754e7aec1 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 200 len: 1723 microversion: 2.20 time: 0.215572 Jun 30 12:42:17.885340 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 447/906] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:42:17 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 1723 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:42:18.910271 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-9fb4d25c-0123-43c7-89a9-9fafb7f62551 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:42:18.911231 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-9fb4d25c-0123-43c7-89a9-9fafb7f62551 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:42:18.918874 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-9fb4d25c-0123-43c7-89a9-9fafb7f62551 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:18.919326 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-9fb4d25c-0123-43c7-89a9-9fafb7f62551 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:18.920091 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-9fb4d25c-0123-43c7-89a9-9fafb7f62551 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:18.920521 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-9fb4d25c-0123-43c7-89a9-9fafb7f62551 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:19.051879 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-9fb4d25c-0123-43c7-89a9-9fafb7f62551 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:19.059961 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-9fb4d25c-0123-43c7-89a9-9fafb7f62551 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:19.061462 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-9fb4d25c-0123-43c7-89a9-9fafb7f62551 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:19.062632 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-9fb4d25c-0123-43c7-89a9-9fafb7f62551 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 200 len: 1723 microversion: 2.20 time: 0.159037 Jun 30 12:42:19.063198 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 460/907] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:42:18 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:42:20.084833 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-7199c9bc-2ee3-4f70-8110-457a3874a1b8 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:42:20.085506 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-7199c9bc-2ee3-4f70-8110-457a3874a1b8 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:42:20.092868 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-7199c9bc-2ee3-4f70-8110-457a3874a1b8 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:20.093340 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-7199c9bc-2ee3-4f70-8110-457a3874a1b8 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:20.094123 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-7199c9bc-2ee3-4f70-8110-457a3874a1b8 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:20.094554 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-7199c9bc-2ee3-4f70-8110-457a3874a1b8 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:20.235576 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-7199c9bc-2ee3-4f70-8110-457a3874a1b8 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:20.244156 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-7199c9bc-2ee3-4f70-8110-457a3874a1b8 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:20.245705 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-7199c9bc-2ee3-4f70-8110-457a3874a1b8 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:20.246855 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-7199c9bc-2ee3-4f70-8110-457a3874a1b8 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 200 len: 1723 microversion: 2.20 time: 0.168432 Jun 30 12:42:20.247414 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 448/908] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:42:20 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:42:21.269558 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-4ed6f89b-832d-4738-bdd3-4059d9b56708 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:42:21.270542 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-4ed6f89b-832d-4738-bdd3-4059d9b56708 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:42:21.282088 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-4ed6f89b-832d-4738-bdd3-4059d9b56708 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:21.282844 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-4ed6f89b-832d-4738-bdd3-4059d9b56708 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:21.284117 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-4ed6f89b-832d-4738-bdd3-4059d9b56708 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:21.284888 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-4ed6f89b-832d-4738-bdd3-4059d9b56708 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:21.422136 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-4ed6f89b-832d-4738-bdd3-4059d9b56708 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:21.430554 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-4ed6f89b-832d-4738-bdd3-4059d9b56708 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:21.432019 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-4ed6f89b-832d-4738-bdd3-4059d9b56708 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:21.433251 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-4ed6f89b-832d-4738-bdd3-4059d9b56708 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 200 len: 1723 microversion: 2.20 time: 0.170409 Jun 30 12:42:21.433772 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 461/909] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:42:21 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:42:22.453704 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-3f6655f9-f4f1-42cb-b210-ae5ea5fef134 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:42:22.454452 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-3f6655f9-f4f1-42cb-b210-ae5ea5fef134 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:42:22.463039 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-3f6655f9-f4f1-42cb-b210-ae5ea5fef134 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:22.463480 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-3f6655f9-f4f1-42cb-b210-ae5ea5fef134 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:22.464230 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-3f6655f9-f4f1-42cb-b210-ae5ea5fef134 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:22.464655 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-3f6655f9-f4f1-42cb-b210-ae5ea5fef134 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:22.599305 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-3f6655f9-f4f1-42cb-b210-ae5ea5fef134 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:22.608047 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-3f6655f9-f4f1-42cb-b210-ae5ea5fef134 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:22.609569 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-3f6655f9-f4f1-42cb-b210-ae5ea5fef134 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:22.610751 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-3f6655f9-f4f1-42cb-b210-ae5ea5fef134 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 200 len: 1723 microversion: 2.20 time: 0.161970 Jun 30 12:42:22.611278 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 449/910] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:42:22 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:42:23.633655 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-43f87355-ca2f-488c-9c2c-ab5aa26a36ea tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:42:23.634231 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-43f87355-ca2f-488c-9c2c-ab5aa26a36ea tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:42:23.641352 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-43f87355-ca2f-488c-9c2c-ab5aa26a36ea tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:23.641801 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-43f87355-ca2f-488c-9c2c-ab5aa26a36ea tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:23.642569 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-43f87355-ca2f-488c-9c2c-ab5aa26a36ea tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:23.643011 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-43f87355-ca2f-488c-9c2c-ab5aa26a36ea tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:23.781628 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-43f87355-ca2f-488c-9c2c-ab5aa26a36ea tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:23.794883 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-43f87355-ca2f-488c-9c2c-ab5aa26a36ea tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:23.797316 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-43f87355-ca2f-488c-9c2c-ab5aa26a36ea tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:23.799151 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-43f87355-ca2f-488c-9c2c-ab5aa26a36ea tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 200 len: 1723 microversion: 2.20 time: 0.172151 Jun 30 12:42:23.799990 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 462/911] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:42:23 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:42:24.821854 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-0377704e-dd8d-42c7-a20d-7225d5b841cb tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:42:24.823254 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-0377704e-dd8d-42c7-a20d-7225d5b841cb tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:42:24.834270 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-0377704e-dd8d-42c7-a20d-7225d5b841cb tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:24.835021 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-0377704e-dd8d-42c7-a20d-7225d5b841cb tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:24.836283 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-0377704e-dd8d-42c7-a20d-7225d5b841cb tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:24.837074 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-0377704e-dd8d-42c7-a20d-7225d5b841cb tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:24.968825 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-0377704e-dd8d-42c7-a20d-7225d5b841cb tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:24.980858 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-0377704e-dd8d-42c7-a20d-7225d5b841cb tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:24.983107 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-0377704e-dd8d-42c7-a20d-7225d5b841cb tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:24.984834 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-0377704e-dd8d-42c7-a20d-7225d5b841cb tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 200 len: 1723 microversion: 2.20 time: 0.169335 Jun 30 12:42:24.985541 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 450/912] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:42:24 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:42:26.014115 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-353913bc-7e6d-4a32-ac20-767c073d17ae tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:42:26.014723 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-353913bc-7e6d-4a32-ac20-767c073d17ae tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:42:26.021352 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-353913bc-7e6d-4a32-ac20-767c073d17ae tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:26.021802 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-353913bc-7e6d-4a32-ac20-767c073d17ae tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:26.022602 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-353913bc-7e6d-4a32-ac20-767c073d17ae tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:26.023045 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-353913bc-7e6d-4a32-ac20-767c073d17ae tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:26.165999 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-353913bc-7e6d-4a32-ac20-767c073d17ae tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:26.175387 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-353913bc-7e6d-4a32-ac20-767c073d17ae tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:26.176920 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-353913bc-7e6d-4a32-ac20-767c073d17ae tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:26.178094 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-353913bc-7e6d-4a32-ac20-767c073d17ae tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 200 len: 1723 microversion: 2.20 time: 0.169073 Jun 30 12:42:26.178657 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 463/913] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:42:26 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:42:27.195696 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-549de6e8-2c1a-40bf-b9e8-6829f1036da0 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:42:27.196309 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-549de6e8-2c1a-40bf-b9e8-6829f1036da0 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:42:27.203522 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-549de6e8-2c1a-40bf-b9e8-6829f1036da0 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:27.203971 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-549de6e8-2c1a-40bf-b9e8-6829f1036da0 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:27.204773 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-549de6e8-2c1a-40bf-b9e8-6829f1036da0 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:27.205212 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-549de6e8-2c1a-40bf-b9e8-6829f1036da0 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:27.341596 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-549de6e8-2c1a-40bf-b9e8-6829f1036da0 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:27.351193 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-549de6e8-2c1a-40bf-b9e8-6829f1036da0 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:27.352662 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-549de6e8-2c1a-40bf-b9e8-6829f1036da0 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:27.353846 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-549de6e8-2c1a-40bf-b9e8-6829f1036da0 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 200 len: 1723 microversion: 2.20 time: 0.162175 Jun 30 12:42:27.354397 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 451/914] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:42:27 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:42:28.376831 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-d7fc3dfb-3d86-49c8-b3d6-c0478b3064d0 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:42:28.377785 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-d7fc3dfb-3d86-49c8-b3d6-c0478b3064d0 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:42:28.388305 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-d7fc3dfb-3d86-49c8-b3d6-c0478b3064d0 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:28.388793 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-d7fc3dfb-3d86-49c8-b3d6-c0478b3064d0 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:28.389552 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-d7fc3dfb-3d86-49c8-b3d6-c0478b3064d0 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:28.389986 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-d7fc3dfb-3d86-49c8-b3d6-c0478b3064d0 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:28.542303 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-d7fc3dfb-3d86-49c8-b3d6-c0478b3064d0 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:28.550890 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-d7fc3dfb-3d86-49c8-b3d6-c0478b3064d0 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:28.552369 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-d7fc3dfb-3d86-49c8-b3d6-c0478b3064d0 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:28.553573 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-d7fc3dfb-3d86-49c8-b3d6-c0478b3064d0 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 200 len: 1723 microversion: 2.20 time: 0.183967 Jun 30 12:42:28.554131 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 464/915] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:42:28 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:42:29.578088 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-6d723ecb-b8c2-4220-899b-bdcc7c12eadb tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:42:29.579122 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-6d723ecb-b8c2-4220-899b-bdcc7c12eadb tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:42:29.589484 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-6d723ecb-b8c2-4220-899b-bdcc7c12eadb tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:29.589917 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-6d723ecb-b8c2-4220-899b-bdcc7c12eadb tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:29.590703 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-6d723ecb-b8c2-4220-899b-bdcc7c12eadb tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:29.591146 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-6d723ecb-b8c2-4220-899b-bdcc7c12eadb tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:29.735894 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-6d723ecb-b8c2-4220-899b-bdcc7c12eadb tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:29.750333 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-6d723ecb-b8c2-4220-899b-bdcc7c12eadb tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:29.752559 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-6d723ecb-b8c2-4220-899b-bdcc7c12eadb tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:29.754259 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-6d723ecb-b8c2-4220-899b-bdcc7c12eadb tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 200 len: 1723 microversion: 2.20 time: 0.183335 Jun 30 12:42:29.754818 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 452/916] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:42:29 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 1723 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:42:30.777278 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-4c930359-36fb-4512-9e6a-fd960dae6f65 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:42:30.777973 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-4c930359-36fb-4512-9e6a-fd960dae6f65 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:42:30.786076 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-4c930359-36fb-4512-9e6a-fd960dae6f65 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:30.786648 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-4c930359-36fb-4512-9e6a-fd960dae6f65 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:30.787548 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-4c930359-36fb-4512-9e6a-fd960dae6f65 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:30.788060 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-4c930359-36fb-4512-9e6a-fd960dae6f65 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:30.925359 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-4c930359-36fb-4512-9e6a-fd960dae6f65 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:30.933738 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-4c930359-36fb-4512-9e6a-fd960dae6f65 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:30.935197 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-4c930359-36fb-4512-9e6a-fd960dae6f65 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:30.936369 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-4c930359-36fb-4512-9e6a-fd960dae6f65 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 200 len: 1723 microversion: 2.20 time: 0.165879 Jun 30 12:42:30.936979 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 465/917] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:42:30 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:42:31.958194 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-030b8890-b8eb-4ab8-ac55-713313495f5c tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:42:31.959226 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-030b8890-b8eb-4ab8-ac55-713313495f5c tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:42:31.970604 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-030b8890-b8eb-4ab8-ac55-713313495f5c tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:31.971345 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-030b8890-b8eb-4ab8-ac55-713313495f5c tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:31.972605 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-030b8890-b8eb-4ab8-ac55-713313495f5c tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:31.973389 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-030b8890-b8eb-4ab8-ac55-713313495f5c tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:31.977812 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG dbcounter [-] [124298] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:42:32.115493 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-030b8890-b8eb-4ab8-ac55-713313495f5c tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:32.125358 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-030b8890-b8eb-4ab8-ac55-713313495f5c tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:32.127520 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-030b8890-b8eb-4ab8-ac55-713313495f5c tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:32.129345 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-030b8890-b8eb-4ab8-ac55-713313495f5c tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 200 len: 1723 microversion: 2.20 time: 0.177427 Jun 30 12:42:32.130110 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 453/918] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:42:31 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:42:33.149403 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-cde26414-8d13-4586-81a2-5eea7ae5b930 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:42:33.150129 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-cde26414-8d13-4586-81a2-5eea7ae5b930 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:42:33.157974 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-cde26414-8d13-4586-81a2-5eea7ae5b930 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:33.158477 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-cde26414-8d13-4586-81a2-5eea7ae5b930 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:33.159331 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-cde26414-8d13-4586-81a2-5eea7ae5b930 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:33.159814 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-cde26414-8d13-4586-81a2-5eea7ae5b930 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:33.301305 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-cde26414-8d13-4586-81a2-5eea7ae5b930 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:33.310195 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-cde26414-8d13-4586-81a2-5eea7ae5b930 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:33.311692 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-cde26414-8d13-4586-81a2-5eea7ae5b930 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:33.312945 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-cde26414-8d13-4586-81a2-5eea7ae5b930 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 200 len: 1723 microversion: 2.20 time: 0.168279 Jun 30 12:42:33.313486 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 466/919] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:42:33 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:42:34.335842 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-2168c38f-613f-4cbe-8020-79d46e647862 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:42:34.336859 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-2168c38f-613f-4cbe-8020-79d46e647862 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:42:34.345454 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-2168c38f-613f-4cbe-8020-79d46e647862 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:34.345898 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-2168c38f-613f-4cbe-8020-79d46e647862 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:34.346653 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-2168c38f-613f-4cbe-8020-79d46e647862 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:34.347077 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-2168c38f-613f-4cbe-8020-79d46e647862 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:34.495276 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-2168c38f-613f-4cbe-8020-79d46e647862 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:34.504923 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-2168c38f-613f-4cbe-8020-79d46e647862 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:34.506758 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-2168c38f-613f-4cbe-8020-79d46e647862 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:34.507925 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-2168c38f-613f-4cbe-8020-79d46e647862 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 200 len: 1723 microversion: 2.20 time: 0.178491 Jun 30 12:42:34.508493 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 454/920] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:42:34 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:42:35.530877 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-3c7d322b-ddcc-4f84-85fd-cc2f2fedaeaf tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:42:35.531831 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-3c7d322b-ddcc-4f84-85fd-cc2f2fedaeaf tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:42:35.542761 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-3c7d322b-ddcc-4f84-85fd-cc2f2fedaeaf tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:35.543296 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-3c7d322b-ddcc-4f84-85fd-cc2f2fedaeaf tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:35.544068 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-3c7d322b-ddcc-4f84-85fd-cc2f2fedaeaf tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:35.544502 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-3c7d322b-ddcc-4f84-85fd-cc2f2fedaeaf tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:35.699582 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-3c7d322b-ddcc-4f84-85fd-cc2f2fedaeaf tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:35.707871 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-3c7d322b-ddcc-4f84-85fd-cc2f2fedaeaf tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:35.709396 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-3c7d322b-ddcc-4f84-85fd-cc2f2fedaeaf tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:35.710553 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-3c7d322b-ddcc-4f84-85fd-cc2f2fedaeaf tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 200 len: 1723 microversion: 2.20 time: 0.186275 Jun 30 12:42:35.711109 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 467/921] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:42:35 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 1723 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:42:36.732992 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-e2951171-bdf1-459d-bfd6-3f848969d7e7 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:42:36.733954 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-e2951171-bdf1-459d-bfd6-3f848969d7e7 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:42:36.745012 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-e2951171-bdf1-459d-bfd6-3f848969d7e7 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:36.745733 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-e2951171-bdf1-459d-bfd6-3f848969d7e7 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:36.746514 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-e2951171-bdf1-459d-bfd6-3f848969d7e7 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:36.746933 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-e2951171-bdf1-459d-bfd6-3f848969d7e7 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:36.904954 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-e2951171-bdf1-459d-bfd6-3f848969d7e7 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:36.916920 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-e2951171-bdf1-459d-bfd6-3f848969d7e7 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:36.918585 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-e2951171-bdf1-459d-bfd6-3f848969d7e7 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:36.919742 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-e2951171-bdf1-459d-bfd6-3f848969d7e7 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 200 len: 1723 microversion: 2.20 time: 0.193408 Jun 30 12:42:36.920298 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 455/922] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:42:36 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 1723 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:42:37.940105 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-55cb74fe-b77e-473f-a3ff-e352d2eac255 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:42:37.940900 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-55cb74fe-b77e-473f-a3ff-e352d2eac255 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:42:37.949687 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-55cb74fe-b77e-473f-a3ff-e352d2eac255 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:37.950234 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-55cb74fe-b77e-473f-a3ff-e352d2eac255 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:37.951183 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-55cb74fe-b77e-473f-a3ff-e352d2eac255 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:37.951820 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-55cb74fe-b77e-473f-a3ff-e352d2eac255 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:38.097213 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-55cb74fe-b77e-473f-a3ff-e352d2eac255 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:38.105607 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-55cb74fe-b77e-473f-a3ff-e352d2eac255 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:38.107088 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-55cb74fe-b77e-473f-a3ff-e352d2eac255 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:38.108259 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-55cb74fe-b77e-473f-a3ff-e352d2eac255 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 200 len: 1723 microversion: 2.20 time: 0.173596 Jun 30 12:42:38.108868 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 468/923] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:42:37 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:42:39.127457 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-5e552a96-4e32-48a2-8273-288ceb053376 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:42:39.128170 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-5e552a96-4e32-48a2-8273-288ceb053376 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:42:39.136746 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-5e552a96-4e32-48a2-8273-288ceb053376 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:39.137197 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-5e552a96-4e32-48a2-8273-288ceb053376 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:39.137963 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-5e552a96-4e32-48a2-8273-288ceb053376 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:39.138397 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-5e552a96-4e32-48a2-8273-288ceb053376 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:39.282075 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-5e552a96-4e32-48a2-8273-288ceb053376 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:39.294918 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-5e552a96-4e32-48a2-8273-288ceb053376 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:39.296435 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-5e552a96-4e32-48a2-8273-288ceb053376 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:39.297636 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-5e552a96-4e32-48a2-8273-288ceb053376 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 200 len: 1723 microversion: 2.20 time: 0.175153 Jun 30 12:42:39.298200 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 456/924] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:42:39 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:42:40.326114 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-cdc6aec8-5ad4-42ca-baf7-afa711124fc8 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:42:40.326741 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-cdc6aec8-5ad4-42ca-baf7-afa711124fc8 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:42:40.336065 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-cdc6aec8-5ad4-42ca-baf7-afa711124fc8 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:40.336757 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-cdc6aec8-5ad4-42ca-baf7-afa711124fc8 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:40.337654 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-cdc6aec8-5ad4-42ca-baf7-afa711124fc8 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:40.338110 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-cdc6aec8-5ad4-42ca-baf7-afa711124fc8 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:40.485188 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-cdc6aec8-5ad4-42ca-baf7-afa711124fc8 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:40.497491 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-cdc6aec8-5ad4-42ca-baf7-afa711124fc8 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:40.498979 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-cdc6aec8-5ad4-42ca-baf7-afa711124fc8 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:40.500140 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-cdc6aec8-5ad4-42ca-baf7-afa711124fc8 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 200 len: 1723 microversion: 2.20 time: 0.180026 Jun 30 12:42:40.500703 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 469/925] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:42:40 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:42:41.522094 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-5c2b00ae-d0f6-4582-b01a-66cc37f43d0b tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:42:41.523329 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-5c2b00ae-d0f6-4582-b01a-66cc37f43d0b tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:42:41.534345 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-5c2b00ae-d0f6-4582-b01a-66cc37f43d0b tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:41.535037 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-5c2b00ae-d0f6-4582-b01a-66cc37f43d0b tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:41.536240 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-5c2b00ae-d0f6-4582-b01a-66cc37f43d0b tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:41.537011 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-5c2b00ae-d0f6-4582-b01a-66cc37f43d0b tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:41.683701 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-5c2b00ae-d0f6-4582-b01a-66cc37f43d0b tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:41.692070 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-5c2b00ae-d0f6-4582-b01a-66cc37f43d0b tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:41.693614 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-5c2b00ae-d0f6-4582-b01a-66cc37f43d0b tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:41.694770 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-5c2b00ae-d0f6-4582-b01a-66cc37f43d0b tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 200 len: 1723 microversion: 2.20 time: 0.179059 Jun 30 12:42:41.695336 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 457/926] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:42:41 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:42:42.717982 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-f7cfc7e1-8ae3-4b3c-8641-d6135b1aa86b tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:42:42.718983 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-f7cfc7e1-8ae3-4b3c-8641-d6135b1aa86b tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:42:42.730182 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-f7cfc7e1-8ae3-4b3c-8641-d6135b1aa86b tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:42.730930 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-f7cfc7e1-8ae3-4b3c-8641-d6135b1aa86b tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:42.732200 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-f7cfc7e1-8ae3-4b3c-8641-d6135b1aa86b tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:42.732992 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-f7cfc7e1-8ae3-4b3c-8641-d6135b1aa86b tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:42.886385 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-f7cfc7e1-8ae3-4b3c-8641-d6135b1aa86b tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:42.890628 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-cc2cb241-8e17-43e8-9e20-dea13dcd373b tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:42:42.891160 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-cc2cb241-8e17-43e8-9e20-dea13dcd373b tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: 265d3404-34ac-4563-b1a8-f525c5b63888] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:42:42.895079 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-f7cfc7e1-8ae3-4b3c-8641-d6135b1aa86b tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:42.896565 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-f7cfc7e1-8ae3-4b3c-8641-d6135b1aa86b tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:42.897772 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-f7cfc7e1-8ae3-4b3c-8641-d6135b1aa86b tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 200 len: 1723 microversion: 2.20 time: 0.186685 Jun 30 12:42:42.898699 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 470/927] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:42:42 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 1723 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:42:42.898862 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-cc2cb241-8e17-43e8-9e20-dea13dcd373b tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:42.899264 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-cc2cb241-8e17-43e8-9e20-dea13dcd373b tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:42.900035 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-cc2cb241-8e17-43e8-9e20-dea13dcd373b tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:42.900469 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-cc2cb241-8e17-43e8-9e20-dea13dcd373b tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:42.924283 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-cc2cb241-8e17-43e8-9e20-dea13dcd373b tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "GET /compute/v2.1/servers/265d3404-34ac-4563-b1a8-f525c5b63888/ips" status: 200 len: 149 microversion: 2.1 time: 0.037607 Jun 30 12:42:42.924958 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 458/928] 10.222.0.57 () {58 vars in 1247 bytes} [Thu Jun 30 12:42:42 2022] GET /compute/v2.1/servers/265d3404-34ac-4563-b1a8-f525c5b63888/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:42:43.919157 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-ed5711ea-5365-46bb-bbb0-6bc4e3b2360d tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:42:43.919915 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-ed5711ea-5365-46bb-bbb0-6bc4e3b2360d tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:42:43.928587 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-ed5711ea-5365-46bb-bbb0-6bc4e3b2360d tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:43.929193 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-ed5711ea-5365-46bb-bbb0-6bc4e3b2360d tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:43.930150 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-ed5711ea-5365-46bb-bbb0-6bc4e3b2360d tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:43.930695 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-ed5711ea-5365-46bb-bbb0-6bc4e3b2360d tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:44.074239 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-ed5711ea-5365-46bb-bbb0-6bc4e3b2360d tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:44.086561 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-ed5711ea-5365-46bb-bbb0-6bc4e3b2360d tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:44.089037 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-ed5711ea-5365-46bb-bbb0-6bc4e3b2360d tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:44.090656 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-ed5711ea-5365-46bb-bbb0-6bc4e3b2360d tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 200 len: 1723 microversion: 2.20 time: 0.176908 Jun 30 12:42:44.091224 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 471/929] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:42:43 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:42:44.279068 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-dc104694-0e07-42f2-8707-5de1322000cb tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8e8b360b-0b6a-4665-9c04-2760cec145ac"}} {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:42:44.280249 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-dc104694-0e07-42f2-8707-5de1322000cb tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: 265d3404-34ac-4563-b1a8-f525c5b63888] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:42:44.282564 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG dbcounter [-] [124298] Writing DB stats nova_api:SELECT=28 {{(pid=124298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:42:44.288463 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-dc104694-0e07-42f2-8707-5de1322000cb tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:44.288931 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-dc104694-0e07-42f2-8707-5de1322000cb tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:44.289685 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-dc104694-0e07-42f2-8707-5de1322000cb tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:44.290109 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-dc104694-0e07-42f2-8707-5de1322000cb tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:44.582683 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-dc104694-0e07-42f2-8707-5de1322000cb tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "POST /compute/v2.1/servers/265d3404-34ac-4563-b1a8-f525c5b63888/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.307577 Jun 30 12:42:44.584002 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 459/930] 10.222.0.57 () {60 vars in 1322 bytes} [Thu Jun 30 12:42:44 2022] POST /compute/v2.1/servers/265d3404-34ac-4563-b1a8-f525c5b63888/os-volume_attachments => generated 194 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:42:45.112674 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-02e59d53-68e0-46bb-acb5-8db26cd4eb02 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:42:45.113325 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-02e59d53-68e0-46bb-acb5-8db26cd4eb02 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:42:45.115936 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG dbcounter [-] [124297] Writing DB stats nova_api:SELECT=28 {{(pid=124297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:42:45.121957 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-02e59d53-68e0-46bb-acb5-8db26cd4eb02 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:45.122711 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-02e59d53-68e0-46bb-acb5-8db26cd4eb02 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:45.124123 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-02e59d53-68e0-46bb-acb5-8db26cd4eb02 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:45.124843 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-02e59d53-68e0-46bb-acb5-8db26cd4eb02 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:45.128090 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG dbcounter [-] [124297] Writing DB stats nova_cell1:SELECT=84 {{(pid=124297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:42:45.264163 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-02e59d53-68e0-46bb-acb5-8db26cd4eb02 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:45.272693 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-02e59d53-68e0-46bb-acb5-8db26cd4eb02 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:45.274544 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-02e59d53-68e0-46bb-acb5-8db26cd4eb02 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:45.275737 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-02e59d53-68e0-46bb-acb5-8db26cd4eb02 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 200 len: 1723 microversion: 2.20 time: 0.167353 Jun 30 12:42:45.276292 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 472/931] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:42:45 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:42:46.300712 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-0c2a8b5d-1048-4529-9402-7d9aa59fc05e tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:42:46.302052 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-0c2a8b5d-1048-4529-9402-7d9aa59fc05e tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:42:46.311851 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-0c2a8b5d-1048-4529-9402-7d9aa59fc05e tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:46.312299 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-0c2a8b5d-1048-4529-9402-7d9aa59fc05e tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:46.313123 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-0c2a8b5d-1048-4529-9402-7d9aa59fc05e tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:46.313561 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-0c2a8b5d-1048-4529-9402-7d9aa59fc05e tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:46.461405 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-0c2a8b5d-1048-4529-9402-7d9aa59fc05e tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:46.469863 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-0c2a8b5d-1048-4529-9402-7d9aa59fc05e tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:46.471350 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-0c2a8b5d-1048-4529-9402-7d9aa59fc05e tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:46.472513 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-0c2a8b5d-1048-4529-9402-7d9aa59fc05e tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 200 len: 1723 microversion: 2.20 time: 0.179963 Jun 30 12:42:46.473106 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 460/932] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:42:46 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:42:47.499120 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-a5f0fc39-40a9-4e19-839c-d277ea4b9383 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:42:47.499120 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-a5f0fc39-40a9-4e19-839c-d277ea4b9383 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:42:47.507543 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-a5f0fc39-40a9-4e19-839c-d277ea4b9383 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:47.509006 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-a5f0fc39-40a9-4e19-839c-d277ea4b9383 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:47.510518 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-a5f0fc39-40a9-4e19-839c-d277ea4b9383 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:47.511263 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-a5f0fc39-40a9-4e19-839c-d277ea4b9383 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:47.647414 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-a5f0fc39-40a9-4e19-839c-d277ea4b9383 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:47.656001 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-a5f0fc39-40a9-4e19-839c-d277ea4b9383 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:47.657510 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-a5f0fc39-40a9-4e19-839c-d277ea4b9383 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:47.658709 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-a5f0fc39-40a9-4e19-839c-d277ea4b9383 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 200 len: 1723 microversion: 2.20 time: 0.169883 Jun 30 12:42:47.659288 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 473/933] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:42:47 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:42:48.677814 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-ec13f054-21a9-4fdc-9417-6223e6d89fa3 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:42:48.678396 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-ec13f054-21a9-4fdc-9417-6223e6d89fa3 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:42:48.685313 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-ec13f054-21a9-4fdc-9417-6223e6d89fa3 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:48.685753 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-ec13f054-21a9-4fdc-9417-6223e6d89fa3 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:48.686512 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-ec13f054-21a9-4fdc-9417-6223e6d89fa3 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:48.687156 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-ec13f054-21a9-4fdc-9417-6223e6d89fa3 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:48.822388 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-ec13f054-21a9-4fdc-9417-6223e6d89fa3 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:48.831246 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-ec13f054-21a9-4fdc-9417-6223e6d89fa3 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:48.832757 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-ec13f054-21a9-4fdc-9417-6223e6d89fa3 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:48.833912 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-ec13f054-21a9-4fdc-9417-6223e6d89fa3 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 200 len: 1723 microversion: 2.20 time: 0.160101 Jun 30 12:42:48.834485 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 461/934] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:42:48 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:42:49.856710 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-57961c19-27fc-45eb-b948-ea510c9c7eb6 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:42:49.857857 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-57961c19-27fc-45eb-b948-ea510c9c7eb6 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:42:49.869094 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-57961c19-27fc-45eb-b948-ea510c9c7eb6 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:49.869845 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-57961c19-27fc-45eb-b948-ea510c9c7eb6 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:49.871116 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-57961c19-27fc-45eb-b948-ea510c9c7eb6 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:49.871847 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-57961c19-27fc-45eb-b948-ea510c9c7eb6 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:50.019247 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-57961c19-27fc-45eb-b948-ea510c9c7eb6 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:50.027623 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-57961c19-27fc-45eb-b948-ea510c9c7eb6 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:50.029121 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-57961c19-27fc-45eb-b948-ea510c9c7eb6 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:50.030272 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-57961c19-27fc-45eb-b948-ea510c9c7eb6 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 200 len: 1723 microversion: 2.20 time: 0.180233 Jun 30 12:42:50.031446 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 474/935] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:42:49 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:42:51.054685 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-cd429ca6-07b5-4fe1-919f-b07fb18d3ba7 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:42:51.055268 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-cd429ca6-07b5-4fe1-919f-b07fb18d3ba7 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:42:51.062530 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-cd429ca6-07b5-4fe1-919f-b07fb18d3ba7 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:51.062969 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-cd429ca6-07b5-4fe1-919f-b07fb18d3ba7 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:51.063721 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-cd429ca6-07b5-4fe1-919f-b07fb18d3ba7 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:51.064161 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-cd429ca6-07b5-4fe1-919f-b07fb18d3ba7 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:51.198265 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-cd429ca6-07b5-4fe1-919f-b07fb18d3ba7 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:51.207247 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-cd429ca6-07b5-4fe1-919f-b07fb18d3ba7 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:51.208759 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-cd429ca6-07b5-4fe1-919f-b07fb18d3ba7 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:51.209914 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-cd429ca6-07b5-4fe1-919f-b07fb18d3ba7 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 200 len: 1723 microversion: 2.20 time: 0.159248 Jun 30 12:42:51.210547 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 462/936] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:42:51 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:42:52.150728 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-6c9b0445-4948-40de-8dd1-03ae0ee77e4a tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8e8b360b-0b6a-4665-9c04-2760cec145ac"}} {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:42:52.152168 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-6c9b0445-4948-40de-8dd1-03ae0ee77e4a tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: 265d3404-34ac-4563-b1a8-f525c5b63888] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:42:52.160246 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-6c9b0445-4948-40de-8dd1-03ae0ee77e4a tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:52.160662 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-6c9b0445-4948-40de-8dd1-03ae0ee77e4a tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:52.161420 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-6c9b0445-4948-40de-8dd1-03ae0ee77e4a tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:52.161855 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-6c9b0445-4948-40de-8dd1-03ae0ee77e4a tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:52.229381 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-1b9ba2f2-09fa-4fb3-a69d-923317fcfd67 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:42:52.230009 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-1b9ba2f2-09fa-4fb3-a69d-923317fcfd67 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:42:52.236946 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-1b9ba2f2-09fa-4fb3-a69d-923317fcfd67 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:52.237401 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-1b9ba2f2-09fa-4fb3-a69d-923317fcfd67 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:52.238175 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-1b9ba2f2-09fa-4fb3-a69d-923317fcfd67 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:52.238610 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-1b9ba2f2-09fa-4fb3-a69d-923317fcfd67 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:52.243210 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.wsgi [None req-6c9b0445-4948-40de-8dd1-03ae0ee77e4a tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] HTTP exception thrown: Invalid volume: volume 8e8b360b-0b6a-4665-9c04-2760cec145ac is already attached to instances: 265d3404-34ac-4563-b1a8-f525c5b63888 Jun 30 12:42:52.245005 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-6c9b0445-4948-40de-8dd1-03ae0ee77e4a tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Request method failure captured: Jun 30 12:42:52.245005 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: request: POST /compute/v2.1/servers/265d3404-34ac-4563-b1a8-f525c5b63888/os-volume_attachments HTTP/1.1 Jun 30 12:42:52.245005 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Accept: application/json Jun 30 12:42:52.245005 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Accept-Encoding: identity Jun 30 12:42:52.245005 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Connection: close Jun 30 12:42:52.245005 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Content-Length: 74 Jun 30 12:42:52.245005 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Content-Type: application/json Jun 30 12:42:52.245005 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Host: 10.222.0.57 Jun 30 12:42:52.245005 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Openstack-System-Scope: None Jun 30 12:42:52.245005 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: User-Agent: python-urllib3/1.26.9 Jun 30 12:42:52.245005 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Auth-Token: gAAAAABivZmUr5nE4sldlZsaj95gPYoaAcBmGRBy3I0hmzGn3iQqv5ZAgj-BPoF3DR2aprIIyzc4pOztEbmcfd7zRGCrhNVOgSUbHkrARCCB7THaqy8PU7wn9dODyPqFpdlPJv1XzD49N3q7ykzG0OSF7WObsxYnk2T0E2GFDSZRVSwfbpGoHiI Jun 30 12:42:52.245005 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Domain-Id: None Jun 30 12:42:52.245005 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Domain-Name: None Jun 30 12:42:52.245005 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Identity-Status: Confirmed Jun 30 12:42:52.245005 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Is-Admin-Project: True Jun 30 12:42:52.245005 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Project-Domain-Id: default Jun 30 12:42:52.245005 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Project-Domain-Name: Default Jun 30 12:42:52.245005 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Project-Id: 359201313a944a8fa9881ee6fdea67e2 Jun 30 12:42:52.245005 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Project-Name: tempest-AttachVolumeNegativeTest-110304785 Jun 30 12:42:52.245005 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Role: member,reader Jun 30 12:42:52.245005 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Roles: member,reader Jun 30 12:42:52.246509 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/359201313a944a8fa9881ee6fdea67e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/359201313a944a8fa9881ee6fdea67e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_359201313a944a8fa9881ee6fdea67e2", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/359201313a944a8fa9881ee6fdea67e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 30 12:42:52.246509 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Tenant: tempest-AttachVolumeNegativeTest-110304785 Jun 30 12:42:52.246509 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Tenant-Id: 359201313a944a8fa9881ee6fdea67e2 Jun 30 12:42:52.246509 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-110304785 Jun 30 12:42:52.246509 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User: tempest-AttachVolumeNegativeTest-110304785-project Jun 30 12:42:52.246509 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User-Domain-Id: default Jun 30 12:42:52.246509 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User-Domain-Name: Default Jun 30 12:42:52.246509 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User-Id: e935f2637d124453947b3c78360567a5 Jun 30 12:42:52.246509 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User-Name: tempest-AttachVolumeNegativeTest-110304785-project Jun 30 12:42:52.246509 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Jun 30 12:42:52.246509 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: {"volumeAttachment": {"volumeId": "8e8b360b-0b6a-4665-9c04-2760cec145ac"}} Jun 30 12:42:52.246509 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: method: > Jun 30 12:42:52.250839 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: exception: Invalid volume: volume 8e8b360b-0b6a-4665-9c04-2760cec145ac is already attached to instances: 265d3404-34ac-4563-b1a8-f525c5b63888 Jun 30 12:42:52.250839 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: action_args: {'server_id': '265d3404-34ac-4563-b1a8-f525c5b63888', 'body': {'volumeAttachment': {'volumeId': '8e8b360b-0b6a-4665-9c04-2760cec145ac'}}} Jun 30 12:42:52.250839 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 12:42:52.250839 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:42:52.250839 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 30 12:42:52.250839 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 30 12:42:52.250839 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 30 12:42:52.250839 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 30 12:42:52.250839 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 30 12:42:52.250839 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 30 12:42:52.250839 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 30 12:42:52.250839 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 30 12:42:52.250839 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 30 12:42:52.250839 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 30 12:42:52.250839 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 8e8b360b-0b6a-4665-9c04-2760cec145ac is already attached to instances: 265d3404-34ac-4563-b1a8-f525c5b63888 Jun 30 12:42:52.250839 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:42:52.250839 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:42:52.250839 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:42:52.250839 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:42:52.252137 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:42:52.252137 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:42:52.252137 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 12:42:52.252137 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 12:42:52.252137 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 12:42:52.252137 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 12:42:52.252137 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 30 12:42:52.252137 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 30 12:42:52.252137 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 30 12:42:52.252137 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 30 12:42:52.252137 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 30 12:42:52.252137 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 30 12:42:52.252137 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 30 12:42:52.252137 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 30 12:42:52.252137 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 8e8b360b-0b6a-4665-9c04-2760cec145ac is already attached to instances: 265d3404-34ac-4563-b1a8-f525c5b63888 Jun 30 12:42:52.252137 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:42:52.252137 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:42:52.252137 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:42:52.252137 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:42:52.252137 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:42:52.253423 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:42:52.253423 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 12:42:52.253423 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 12:42:52.253423 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 8e8b360b-0b6a-4665-9c04-2760cec145ac is already attached to instances: 265d3404-34ac-4563-b1a8-f525c5b63888 Jun 30 12:42:52.253423 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:42:52.253423 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-6c9b0445-4948-40de-8dd1-03ae0ee77e4a tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Returning 400 to user: Invalid volume: volume 8e8b360b-0b6a-4665-9c04-2760cec145ac is already attached to instances: 265d3404-34ac-4563-b1a8-f525c5b63888 {{(pid=124297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 12:42:52.253423 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-6c9b0445-4948-40de-8dd1-03ae0ee77e4a tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "POST /compute/v2.1/servers/265d3404-34ac-4563-b1a8-f525c5b63888/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.102663 Jun 30 12:42:52.253423 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 475/937] 10.222.0.57 () {60 vars in 1322 bytes} [Thu Jun 30 12:42:52 2022] POST /compute/v2.1/servers/265d3404-34ac-4563-b1a8-f525c5b63888/os-volume_attachments => generated 174 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 30 12:42:52.309959 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-c7ed7bad-7a0b-4cc2-8f05-717a1d121265 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:42:52.310446 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-c7ed7bad-7a0b-4cc2-8f05-717a1d121265 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: 265d3404-34ac-4563-b1a8-f525c5b63888] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:42:52.317467 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-c7ed7bad-7a0b-4cc2-8f05-717a1d121265 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:52.317917 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-c7ed7bad-7a0b-4cc2-8f05-717a1d121265 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:52.318677 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-c7ed7bad-7a0b-4cc2-8f05-717a1d121265 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:52.319102 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-c7ed7bad-7a0b-4cc2-8f05-717a1d121265 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:52.377746 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-1b9ba2f2-09fa-4fb3-a69d-923317fcfd67 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:52.386590 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-1b9ba2f2-09fa-4fb3-a69d-923317fcfd67 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:52.388082 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-1b9ba2f2-09fa-4fb3-a69d-923317fcfd67 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:52.389282 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-1b9ba2f2-09fa-4fb3-a69d-923317fcfd67 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 200 len: 1723 microversion: 2.20 time: 0.164140 Jun 30 12:42:52.389961 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 463/938] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:42:52 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:42:52.402364 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.objects.instance [None req-c7ed7bad-7a0b-4cc2-8f05-717a1d121265 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lazy-loading 'services' on Instance uuid 265d3404-34ac-4563-b1a8-f525c5b63888 {{(pid=124297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 12:42:52.481151 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-c7ed7bad-7a0b-4cc2-8f05-717a1d121265 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "DELETE /compute/v2.1/servers/265d3404-34ac-4563-b1a8-f525c5b63888/os-volume_attachments/8e8b360b-0b6a-4665-9c04-2760cec145ac" status: 202 len: 0 microversion: 2.1 time: 0.174888 Jun 30 12:42:52.481715 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 476/939] 10.222.0.57 () {58 vars in 1415 bytes} [Thu Jun 30 12:42:52 2022] DELETE /compute/v2.1/servers/265d3404-34ac-4563-b1a8-f525c5b63888/os-volume_attachments/8e8b360b-0b6a-4665-9c04-2760cec145ac => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 12:42:52.490197 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-aece8370-b8af-4f65-a385-003dd2ddd6ef tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:42:52.491132 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-aece8370-b8af-4f65-a385-003dd2ddd6ef tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: 265d3404-34ac-4563-b1a8-f525c5b63888] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:42:52.497132 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-aece8370-b8af-4f65-a385-003dd2ddd6ef tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:52.497771 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-aece8370-b8af-4f65-a385-003dd2ddd6ef tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:52.498543 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-aece8370-b8af-4f65-a385-003dd2ddd6ef tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:52.499067 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-aece8370-b8af-4f65-a385-003dd2ddd6ef tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:52.685946 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-aece8370-b8af-4f65-a385-003dd2ddd6ef tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "GET /compute/v2.1/servers/265d3404-34ac-4563-b1a8-f525c5b63888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.199470 Jun 30 12:42:52.686401 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 464/940] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jun 30 12:42:52 2022] GET /compute/v2.1/servers/265d3404-34ac-4563-b1a8-f525c5b63888/os-volume_attachments => generated 197 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:42:53.408758 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-81e9e49a-e935-4c47-8ce2-b5ae1aaa57a9 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:42:53.409444 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-81e9e49a-e935-4c47-8ce2-b5ae1aaa57a9 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:42:53.416466 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-81e9e49a-e935-4c47-8ce2-b5ae1aaa57a9 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:53.416948 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-81e9e49a-e935-4c47-8ce2-b5ae1aaa57a9 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:53.417704 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-81e9e49a-e935-4c47-8ce2-b5ae1aaa57a9 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:53.418105 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-81e9e49a-e935-4c47-8ce2-b5ae1aaa57a9 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:53.555703 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-81e9e49a-e935-4c47-8ce2-b5ae1aaa57a9 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:53.564395 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-81e9e49a-e935-4c47-8ce2-b5ae1aaa57a9 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:53.565847 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-81e9e49a-e935-4c47-8ce2-b5ae1aaa57a9 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:53.567014 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-81e9e49a-e935-4c47-8ce2-b5ae1aaa57a9 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 200 len: 1723 microversion: 2.20 time: 0.162870 Jun 30 12:42:53.567573 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 477/941] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:42:53 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 12:42:53.701794 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-17ce5b54-7f85-42eb-b4c2-1f876d64e40a tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:42:53.703287 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-17ce5b54-7f85-42eb-b4c2-1f876d64e40a tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: 265d3404-34ac-4563-b1a8-f525c5b63888] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:42:53.714258 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-17ce5b54-7f85-42eb-b4c2-1f876d64e40a tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:53.714994 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-17ce5b54-7f85-42eb-b4c2-1f876d64e40a tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:53.716239 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-17ce5b54-7f85-42eb-b4c2-1f876d64e40a tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:53.717039 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-17ce5b54-7f85-42eb-b4c2-1f876d64e40a tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:53.746776 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-17ce5b54-7f85-42eb-b4c2-1f876d64e40a tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "GET /compute/v2.1/servers/265d3404-34ac-4563-b1a8-f525c5b63888/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051772 Jun 30 12:42:53.747288 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 465/942] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jun 30 12:42:53 2022] GET /compute/v2.1/servers/265d3404-34ac-4563-b1a8-f525c5b63888/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 30 12:42:53.814075 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-1195634a-f99e-4ece-92fa-289b871bffd2 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:42:53.814852 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-1195634a-f99e-4ece-92fa-289b871bffd2 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: 265d3404-34ac-4563-b1a8-f525c5b63888] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:42:53.824780 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-1195634a-f99e-4ece-92fa-289b871bffd2 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:53.825392 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-1195634a-f99e-4ece-92fa-289b871bffd2 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:53.826600 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-1195634a-f99e-4ece-92fa-289b871bffd2 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:53.827223 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-1195634a-f99e-4ece-92fa-289b871bffd2 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:53.864092 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-1195634a-f99e-4ece-92fa-289b871bffd2 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: 265d3404-34ac-4563-b1a8-f525c5b63888] Going to try to terminate instance {{(pid=124297) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 12:42:53.950471 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-1195634a-f99e-4ece-92fa-289b871bffd2 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "DELETE /compute/v2.1/servers/265d3404-34ac-4563-b1a8-f525c5b63888" status: 204 len: 0 microversion: 2.1 time: 0.141777 Jun 30 12:42:53.951285 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 478/943] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 30 12:42:53 2022] DELETE /compute/v2.1/servers/265d3404-34ac-4563-b1a8-f525c5b63888 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 12:42:53.960389 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-d444f059-f3bf-4d46-9cfc-db8c00e86884 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:42:53.961027 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-d444f059-f3bf-4d46-9cfc-db8c00e86884 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: 265d3404-34ac-4563-b1a8-f525c5b63888] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:42:53.967232 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-d444f059-f3bf-4d46-9cfc-db8c00e86884 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:53.967692 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-d444f059-f3bf-4d46-9cfc-db8c00e86884 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:53.968450 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-d444f059-f3bf-4d46-9cfc-db8c00e86884 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:53.968972 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-d444f059-f3bf-4d46-9cfc-db8c00e86884 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:54.289348 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-d444f059-f3bf-4d46-9cfc-db8c00e86884 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e935f2637d124453947b3c78360567a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359201313a944a8fa9881ee6fdea67e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:54.297369 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-d444f059-f3bf-4d46-9cfc-db8c00e86884 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "GET /compute/v2.1/servers/265d3404-34ac-4563-b1a8-f525c5b63888" status: 200 len: 1681 microversion: 2.1 time: 0.340854 Jun 30 12:42:54.297998 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 466/944] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:42:53 2022] GET /compute/v2.1/servers/265d3404-34ac-4563-b1a8-f525c5b63888 => generated 1681 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 12:42:54.586210 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-8081ceaa-f7a0-457a-8623-5a27c2095c0e tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:42:54.586896 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-8081ceaa-f7a0-457a-8623-5a27c2095c0e tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:42:54.593217 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-8081ceaa-f7a0-457a-8623-5a27c2095c0e tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:54.593622 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-8081ceaa-f7a0-457a-8623-5a27c2095c0e tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:54.595035 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-8081ceaa-f7a0-457a-8623-5a27c2095c0e tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:54.595465 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-8081ceaa-f7a0-457a-8623-5a27c2095c0e tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:54.777343 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-8081ceaa-f7a0-457a-8623-5a27c2095c0e tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:54.786871 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-8081ceaa-f7a0-457a-8623-5a27c2095c0e tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:54.788337 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-8081ceaa-f7a0-457a-8623-5a27c2095c0e tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:54.789543 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-8081ceaa-f7a0-457a-8623-5a27c2095c0e tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 200 len: 1723 microversion: 2.20 time: 0.207775 Jun 30 12:42:54.790092 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 479/945] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:42:54 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 1723 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:42:55.315342 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-a010d5bc-c207-48ed-85c8-df79685b0f21 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:42:55.315954 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-a010d5bc-c207-48ed-85c8-df79685b0f21 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: 265d3404-34ac-4563-b1a8-f525c5b63888] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:42:55.323285 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-a010d5bc-c207-48ed-85c8-df79685b0f21 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:55.323718 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-a010d5bc-c207-48ed-85c8-df79685b0f21 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:55.324515 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-a010d5bc-c207-48ed-85c8-df79685b0f21 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:55.324994 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-a010d5bc-c207-48ed-85c8-df79685b0f21 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:55.627740 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-1b610a67-12a3-46cc-b1b1-70d7f4154d7c tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:42:55.629088 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-1b610a67-12a3-46cc-b1b1-70d7f4154d7c tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] [instance: 6c8d44a3-c5aa-4d56-9a74-ad0c7b75cacc] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:42:55.633436 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-a010d5bc-c207-48ed-85c8-df79685b0f21 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e935f2637d124453947b3c78360567a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359201313a944a8fa9881ee6fdea67e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:55.636021 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-1b610a67-12a3-46cc-b1b1-70d7f4154d7c tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:55.637531 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-1b610a67-12a3-46cc-b1b1-70d7f4154d7c tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:55.638928 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-1b610a67-12a3-46cc-b1b1-70d7f4154d7c tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:55.639611 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-1b610a67-12a3-46cc-b1b1-70d7f4154d7c tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:55.643129 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-a010d5bc-c207-48ed-85c8-df79685b0f21 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "GET /compute/v2.1/servers/265d3404-34ac-4563-b1a8-f525c5b63888" status: 200 len: 1681 microversion: 2.1 time: 0.332252 Jun 30 12:42:55.644273 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 467/946] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:42:55 2022] GET /compute/v2.1/servers/265d3404-34ac-4563-b1a8-f525c5b63888 => generated 1681 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:42:55.649285 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [req-97d7b0ed-07bd-4814-938f-c622d9ab0655 req-df01858f-55c2-4e2c-9753-6aeac5acd74d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c8d44a3-c5aa-4d56-9a74-ad0c7b75cacc", "tag": "df846a02-3229-4085-9232-fce8e68d513e"}]} {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:42:55.657897 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [req-97d7b0ed-07bd-4814-938f-c622d9ab0655 req-df01858f-55c2-4e2c-9753-6aeac5acd74d service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:55.658614 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [req-97d7b0ed-07bd-4814-938f-c622d9ab0655 req-df01858f-55c2-4e2c-9753-6aeac5acd74d service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:55.669973 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.compute.server_external_events [req-97d7b0ed-07bd-4814-938f-c622d9ab0655 req-df01858f-55c2-4e2c-9753-6aeac5acd74d service nova] Creating event network-changed:df846a02-3229-4085-9232-fce8e68d513e for instance 6c8d44a3-c5aa-4d56-9a74-ad0c7b75cacc on hv-cinder-84614 Jun 30 12:42:55.672374 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-1b610a67-12a3-46cc-b1b1-70d7f4154d7c tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] [instance: 6c8d44a3-c5aa-4d56-9a74-ad0c7b75cacc] Going to try to terminate instance {{(pid=124297) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 12:42:55.675753 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [req-97d7b0ed-07bd-4814-938f-c622d9ab0655 req-df01858f-55c2-4e2c-9753-6aeac5acd74d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030099 Jun 30 12:42:55.676433 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 468/947] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 30 12:42:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:42:55.761939 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-1b610a67-12a3-46cc-b1b1-70d7f4154d7c tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] 10.222.0.57 "DELETE /compute/v2.1/servers/6c8d44a3-c5aa-4d56-9a74-ad0c7b75cacc" status: 204 len: 0 microversion: 2.1 time: 0.138263 Jun 30 12:42:55.761939 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 480/948] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 30 12:42:55 2022] DELETE /compute/v2.1/servers/6c8d44a3-c5aa-4d56-9a74-ad0c7b75cacc => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 12:42:55.771772 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-6ab6ca98-c0c6-4d3f-99a6-880ef50336b1 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:42:55.772887 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-6ab6ca98-c0c6-4d3f-99a6-880ef50336b1 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] [instance: 6c8d44a3-c5aa-4d56-9a74-ad0c7b75cacc] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:42:55.780096 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-6ab6ca98-c0c6-4d3f-99a6-880ef50336b1 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:55.781050 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-6ab6ca98-c0c6-4d3f-99a6-880ef50336b1 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:55.782131 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-6ab6ca98-c0c6-4d3f-99a6-880ef50336b1 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:55.782568 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-6ab6ca98-c0c6-4d3f-99a6-880ef50336b1 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:55.799189 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG dbcounter [-] [124298] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:42:55.809349 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-772f6e01-143c-43f2-b2f5-d5888b61d3d5 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:42:55.810191 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-772f6e01-143c-43f2-b2f5-d5888b61d3d5 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:42:55.816512 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-772f6e01-143c-43f2-b2f5-d5888b61d3d5 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:55.817027 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-772f6e01-143c-43f2-b2f5-d5888b61d3d5 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:55.817865 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-772f6e01-143c-43f2-b2f5-d5888b61d3d5 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:55.818306 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-772f6e01-143c-43f2-b2f5-d5888b61d3d5 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:55.999495 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-6ab6ca98-c0c6-4d3f-99a6-880ef50336b1 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72419918d6c34080b6a4a4c73b2c06b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b272349089480984fd1c5eabe6dce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:56.011915 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-772f6e01-143c-43f2-b2f5-d5888b61d3d5 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:56.018231 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-6ab6ca98-c0c6-4d3f-99a6-880ef50336b1 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] 10.222.0.57 "GET /compute/v2.1/servers/6c8d44a3-c5aa-4d56-9a74-ad0c7b75cacc" status: 200 len: 1578 microversion: 2.1 time: 0.251050 Jun 30 12:42:56.019058 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 469/949] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:42:55 2022] GET /compute/v2.1/servers/6c8d44a3-c5aa-4d56-9a74-ad0c7b75cacc => generated 1578 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:42:56.022178 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-772f6e01-143c-43f2-b2f5-d5888b61d3d5 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:56.024021 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-772f6e01-143c-43f2-b2f5-d5888b61d3d5 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:56.025417 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-772f6e01-143c-43f2-b2f5-d5888b61d3d5 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 200 len: 1723 microversion: 2.20 time: 0.220540 Jun 30 12:42:56.026281 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 481/950] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:42:55 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 1723 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:42:56.597746 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [req-2c9d9616-818a-47d3-b552-0e727bb603ad req-37ed61d3-48b8-4df8-9bb9-7c5e4b6beeea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "265d3404-34ac-4563-b1a8-f525c5b63888", "name": "network-vif-deleted", "tag": "07c1943e-c807-44db-b4e7-223826130edc"}]} {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:42:56.607090 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [req-2c9d9616-818a-47d3-b552-0e727bb603ad req-37ed61d3-48b8-4df8-9bb9-7c5e4b6beeea service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:56.607537 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [req-2c9d9616-818a-47d3-b552-0e727bb603ad req-37ed61d3-48b8-4df8-9bb9-7c5e4b6beeea service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:56.619975 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.compute.server_external_events [req-2c9d9616-818a-47d3-b552-0e727bb603ad req-37ed61d3-48b8-4df8-9bb9-7c5e4b6beeea service nova] Creating event network-vif-deleted:07c1943e-c807-44db-b4e7-223826130edc for instance 265d3404-34ac-4563-b1a8-f525c5b63888 on hv-cinder-84614 Jun 30 12:42:56.625207 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [req-2c9d9616-818a-47d3-b552-0e727bb603ad req-37ed61d3-48b8-4df8-9bb9-7c5e4b6beeea service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031375 Jun 30 12:42:56.625918 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 470/951] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 30 12:42:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:42:56.660525 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-2c351fdc-ffbe-4272-a1b5-f654b25af6d4 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:42:56.661166 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-2c351fdc-ffbe-4272-a1b5-f654b25af6d4 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: 265d3404-34ac-4563-b1a8-f525c5b63888] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:42:56.667510 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-2c351fdc-ffbe-4272-a1b5-f654b25af6d4 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:56.667951 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-2c351fdc-ffbe-4272-a1b5-f654b25af6d4 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:56.673145 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-2c351fdc-ffbe-4272-a1b5-f654b25af6d4 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:56.673726 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-2c351fdc-ffbe-4272-a1b5-f654b25af6d4 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:56.845097 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-2c351fdc-ffbe-4272-a1b5-f654b25af6d4 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e935f2637d124453947b3c78360567a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359201313a944a8fa9881ee6fdea67e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:56.853006 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-2c351fdc-ffbe-4272-a1b5-f654b25af6d4 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "GET /compute/v2.1/servers/265d3404-34ac-4563-b1a8-f525c5b63888" status: 200 len: 1614 microversion: 2.1 time: 0.196284 Jun 30 12:42:56.853610 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 482/952] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:42:56 2022] GET /compute/v2.1/servers/265d3404-34ac-4563-b1a8-f525c5b63888 => generated 1614 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:42:57.036211 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-653d0e5c-77be-4151-9a4f-acca5d20033c tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:42:57.037048 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-653d0e5c-77be-4151-9a4f-acca5d20033c tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] [instance: 6c8d44a3-c5aa-4d56-9a74-ad0c7b75cacc] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:42:57.044023 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-653d0e5c-77be-4151-9a4f-acca5d20033c tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:57.044508 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-653d0e5c-77be-4151-9a4f-acca5d20033c tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:57.044904 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-f84a41a0-b8d8-4188-8639-a75edaee737b tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:42:57.045305 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-653d0e5c-77be-4151-9a4f-acca5d20033c tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:57.045733 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-f84a41a0-b8d8-4188-8639-a75edaee737b tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:42:57.045852 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-653d0e5c-77be-4151-9a4f-acca5d20033c tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:57.052533 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-f84a41a0-b8d8-4188-8639-a75edaee737b tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:57.053010 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-f84a41a0-b8d8-4188-8639-a75edaee737b tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:57.053869 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-f84a41a0-b8d8-4188-8639-a75edaee737b tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:57.054384 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-f84a41a0-b8d8-4188-8639-a75edaee737b tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:57.248226 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-653d0e5c-77be-4151-9a4f-acca5d20033c tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72419918d6c34080b6a4a4c73b2c06b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b272349089480984fd1c5eabe6dce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:57.252243 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-f84a41a0-b8d8-4188-8639-a75edaee737b tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:57.256952 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-653d0e5c-77be-4151-9a4f-acca5d20033c tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] 10.222.0.57 "GET /compute/v2.1/servers/6c8d44a3-c5aa-4d56-9a74-ad0c7b75cacc" status: 200 len: 1578 microversion: 2.1 time: 0.224929 Jun 30 12:42:57.258278 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 471/953] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:42:57 2022] GET /compute/v2.1/servers/6c8d44a3-c5aa-4d56-9a74-ad0c7b75cacc => generated 1578 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:42:57.262265 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-f84a41a0-b8d8-4188-8639-a75edaee737b tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:57.263742 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-f84a41a0-b8d8-4188-8639-a75edaee737b tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:57.265104 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-f84a41a0-b8d8-4188-8639-a75edaee737b tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 200 len: 1723 microversion: 2.20 time: 0.225780 Jun 30 12:42:57.267663 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 483/954] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:42:57 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 1723 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 12:42:57.870817 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-e5b9e28b-ad75-482d-aac0-fb312e7005f6 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:42:57.871509 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-e5b9e28b-ad75-482d-aac0-fb312e7005f6 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: 265d3404-34ac-4563-b1a8-f525c5b63888] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:42:57.878928 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-e5b9e28b-ad75-482d-aac0-fb312e7005f6 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:57.879371 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-e5b9e28b-ad75-482d-aac0-fb312e7005f6 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:57.880139 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-e5b9e28b-ad75-482d-aac0-fb312e7005f6 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:57.880565 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-e5b9e28b-ad75-482d-aac0-fb312e7005f6 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:57.914685 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-e5b9e28b-ad75-482d-aac0-fb312e7005f6 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:57.915128 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-e5b9e28b-ad75-482d-aac0-fb312e7005f6 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:57.915575 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.objects.instance [None req-e5b9e28b-ad75-482d-aac0-fb312e7005f6 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lazy-loading 'fault' on Instance uuid 265d3404-34ac-4563-b1a8-f525c5b63888 {{(pid=124298) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 12:42:57.961638 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-e5b9e28b-ad75-482d-aac0-fb312e7005f6 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e935f2637d124453947b3c78360567a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359201313a944a8fa9881ee6fdea67e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:57.971206 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-e5b9e28b-ad75-482d-aac0-fb312e7005f6 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "GET /compute/v2.1/servers/265d3404-34ac-4563-b1a8-f525c5b63888" status: 200 len: 1332 microversion: 2.1 time: 0.104324 Jun 30 12:42:57.972566 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 472/955] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:42:57 2022] GET /compute/v2.1/servers/265d3404-34ac-4563-b1a8-f525c5b63888 => generated 1332 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:42:58.287538 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-cc913763-e601-42b8-a750-7d73a140b0a7 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:42:58.288418 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-cc913763-e601-42b8-a750-7d73a140b0a7 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] [instance: 6c8d44a3-c5aa-4d56-9a74-ad0c7b75cacc] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:42:58.292497 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-9b7ab3fb-eeb6-40f7-8479-f156d60467a4 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:42:58.294136 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-9b7ab3fb-eeb6-40f7-8479-f156d60467a4 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:42:58.298374 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-cc913763-e601-42b8-a750-7d73a140b0a7 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:58.298830 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-cc913763-e601-42b8-a750-7d73a140b0a7 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:58.299615 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-cc913763-e601-42b8-a750-7d73a140b0a7 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:58.300054 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-cc913763-e601-42b8-a750-7d73a140b0a7 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:58.301587 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-9b7ab3fb-eeb6-40f7-8479-f156d60467a4 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:58.302039 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-9b7ab3fb-eeb6-40f7-8479-f156d60467a4 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:58.303427 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-9b7ab3fb-eeb6-40f7-8479-f156d60467a4 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:58.303979 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-9b7ab3fb-eeb6-40f7-8479-f156d60467a4 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:58.376400 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-cc913763-e601-42b8-a750-7d73a140b0a7 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72419918d6c34080b6a4a4c73b2c06b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b272349089480984fd1c5eabe6dce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:58.379049 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG dbcounter [-] [124297] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=124297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:42:58.386357 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-cc913763-e601-42b8-a750-7d73a140b0a7 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] 10.222.0.57 "GET /compute/v2.1/servers/6c8d44a3-c5aa-4d56-9a74-ad0c7b75cacc" status: 200 len: 1392 microversion: 2.1 time: 0.105645 Jun 30 12:42:58.387882 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 484/956] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:42:58 2022] GET /compute/v2.1/servers/6c8d44a3-c5aa-4d56-9a74-ad0c7b75cacc => generated 1392 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:42:58.467968 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-9b7ab3fb-eeb6-40f7-8479-f156d60467a4 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:58.477208 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-9b7ab3fb-eeb6-40f7-8479-f156d60467a4 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:58.478700 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-9b7ab3fb-eeb6-40f7-8479-f156d60467a4 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:58.479885 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-9b7ab3fb-eeb6-40f7-8479-f156d60467a4 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 200 len: 1723 microversion: 2.20 time: 0.193816 Jun 30 12:42:58.480452 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 473/957] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:42:58 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 1723 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:42:58.642014 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [req-952b29d2-1d73-402d-9a47-c8db178c7e7a req-b41b5c09-c163-4443-8c12-ff1b91fac582 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c8d44a3-c5aa-4d56-9a74-ad0c7b75cacc", "name": "network-vif-deleted", "tag": "df846a02-3229-4085-9232-fce8e68d513e"}]} {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:42:58.660452 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [req-952b29d2-1d73-402d-9a47-c8db178c7e7a req-b41b5c09-c163-4443-8c12-ff1b91fac582 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:58.660997 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [req-952b29d2-1d73-402d-9a47-c8db178c7e7a req-b41b5c09-c163-4443-8c12-ff1b91fac582 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:58.673923 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.compute.server_external_events [req-952b29d2-1d73-402d-9a47-c8db178c7e7a req-b41b5c09-c163-4443-8c12-ff1b91fac582 service nova] Creating event network-vif-deleted:df846a02-3229-4085-9232-fce8e68d513e for instance 6c8d44a3-c5aa-4d56-9a74-ad0c7b75cacc on hv-cinder-84614 Jun 30 12:42:58.678891 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [req-952b29d2-1d73-402d-9a47-c8db178c7e7a req-b41b5c09-c163-4443-8c12-ff1b91fac582 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041804 Jun 30 12:42:58.679547 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 485/958] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 30 12:42:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:42:58.989231 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-6da05d7e-c626-472f-aef4-18fd26b540b6 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:42:58.989847 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-6da05d7e-c626-472f-aef4-18fd26b540b6 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: 265d3404-34ac-4563-b1a8-f525c5b63888] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:42:58.997007 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-6da05d7e-c626-472f-aef4-18fd26b540b6 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:58.997448 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-6da05d7e-c626-472f-aef4-18fd26b540b6 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:58.998237 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-6da05d7e-c626-472f-aef4-18fd26b540b6 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:58.998657 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-6da05d7e-c626-472f-aef4-18fd26b540b6 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:59.012981 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.wsgi [None req-6da05d7e-c626-472f-aef4-18fd26b540b6 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] HTTP exception thrown: Instance 265d3404-34ac-4563-b1a8-f525c5b63888 could not be found. Jun 30 12:42:59.014642 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-6da05d7e-c626-472f-aef4-18fd26b540b6 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Request method failure captured: Jun 30 12:42:59.014642 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: request: GET /compute/v2.1/servers/265d3404-34ac-4563-b1a8-f525c5b63888 HTTP/1.1 Jun 30 12:42:59.014642 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Accept: application/json Jun 30 12:42:59.014642 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Accept-Encoding: identity Jun 30 12:42:59.014642 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Connection: close Jun 30 12:42:59.014642 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Content-Length: 0 Jun 30 12:42:59.014642 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Content-Type: application/json Jun 30 12:42:59.014642 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Host: 10.222.0.57 Jun 30 12:42:59.014642 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Openstack-System-Scope: None Jun 30 12:42:59.014642 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: User-Agent: python-urllib3/1.26.9 Jun 30 12:42:59.014642 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Auth-Token: gAAAAABivZmUr5nE4sldlZsaj95gPYoaAcBmGRBy3I0hmzGn3iQqv5ZAgj-BPoF3DR2aprIIyzc4pOztEbmcfd7zRGCrhNVOgSUbHkrARCCB7THaqy8PU7wn9dODyPqFpdlPJv1XzD49N3q7ykzG0OSF7WObsxYnk2T0E2GFDSZRVSwfbpGoHiI Jun 30 12:42:59.014642 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Domain-Id: None Jun 30 12:42:59.014642 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Domain-Name: None Jun 30 12:42:59.014642 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Identity-Status: Confirmed Jun 30 12:42:59.014642 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Is-Admin-Project: True Jun 30 12:42:59.014642 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Domain-Id: default Jun 30 12:42:59.014642 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Domain-Name: Default Jun 30 12:42:59.014642 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Id: 359201313a944a8fa9881ee6fdea67e2 Jun 30 12:42:59.014642 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Name: tempest-AttachVolumeNegativeTest-110304785 Jun 30 12:42:59.014642 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Role: member,reader Jun 30 12:42:59.014642 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Roles: member,reader Jun 30 12:42:59.016317 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/359201313a944a8fa9881ee6fdea67e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/359201313a944a8fa9881ee6fdea67e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_359201313a944a8fa9881ee6fdea67e2", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/359201313a944a8fa9881ee6fdea67e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 30 12:42:59.016317 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant: tempest-AttachVolumeNegativeTest-110304785 Jun 30 12:42:59.016317 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant-Id: 359201313a944a8fa9881ee6fdea67e2 Jun 30 12:42:59.016317 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-110304785 Jun 30 12:42:59.016317 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User: tempest-AttachVolumeNegativeTest-110304785-project Jun 30 12:42:59.016317 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Domain-Id: default Jun 30 12:42:59.016317 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Domain-Name: Default Jun 30 12:42:59.016317 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Id: e935f2637d124453947b3c78360567a5 Jun 30 12:42:59.016317 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Name: tempest-AttachVolumeNegativeTest-110304785-project Jun 30 12:42:59.016317 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: method: > Jun 30 12:42:59.016317 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: exception: Instance 265d3404-34ac-4563-b1a8-f525c5b63888 could not be found. Jun 30 12:42:59.016317 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: action_args: {'id': '265d3404-34ac-4563-b1a8-f525c5b63888'} Jun 30 12:42:59.017158 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 12:42:59.017158 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:42:59.017158 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 12:42:59.017158 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 12:42:59.017158 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 12:42:59.017158 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 12:42:59.017158 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 12:42:59.017158 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 12:42:59.017158 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 12:42:59.017158 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 12:42:59.017158 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 265d3404-34ac-4563-b1a8-f525c5b63888 could not be found. Jun 30 12:42:59.017158 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:42:59.017158 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:42:59.017158 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:42:59.017158 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:42:59.017158 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:42:59.017158 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:42:59.017158 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 12:42:59.017158 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 12:42:59.017158 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 12:42:59.018429 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 12:42:59.018429 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 12:42:59.018429 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 12:42:59.018429 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 12:42:59.018429 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 12:42:59.018429 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 12:42:59.018429 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 12:42:59.018429 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 265d3404-34ac-4563-b1a8-f525c5b63888 could not be found. Jun 30 12:42:59.018429 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:42:59.018429 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:42:59.018429 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:42:59.018429 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:42:59.018429 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:42:59.018429 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:42:59.018429 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 12:42:59.018429 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 12:42:59.018429 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 265d3404-34ac-4563-b1a8-f525c5b63888 could not be found. Jun 30 12:42:59.018429 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:42:59.019794 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-6da05d7e-c626-472f-aef4-18fd26b540b6 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Returning 404 to user: Instance 265d3404-34ac-4563-b1a8-f525c5b63888 could not be found. {{(pid=124298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 12:42:59.019794 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-6da05d7e-c626-472f-aef4-18fd26b540b6 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "GET /compute/v2.1/servers/265d3404-34ac-4563-b1a8-f525c5b63888" status: 404 len: 111 microversion: 2.1 time: 0.030941 Jun 30 12:42:59.019794 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 474/959] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:42:58 2022] GET /compute/v2.1/servers/265d3404-34ac-4563-b1a8-f525c5b63888 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 12:42:59.026240 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-bfe418cf-dcd9-4f63-9781-3e532c971a9c tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Calling method '.version_select at 0x7fd0e0143dc0>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:42:59.044763 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-bfe418cf-dcd9-4f63-9781-3e532c971a9c tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1445727894" status: 202 len: 0 microversion: 2.1 time: 0.023080 Jun 30 12:42:59.045346 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 486/960] 10.222.0.57 () {58 vars in 1220 bytes} [Thu Jun 30 12:42:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1445727894 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 12:42:59.406450 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-e1bc56e1-c651-4b6e-beeb-e9285f71cece tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:42:59.408110 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-e1bc56e1-c651-4b6e-beeb-e9285f71cece tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] [instance: 6c8d44a3-c5aa-4d56-9a74-ad0c7b75cacc] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:42:59.414651 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-e1bc56e1-c651-4b6e-beeb-e9285f71cece tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:59.415133 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-e1bc56e1-c651-4b6e-beeb-e9285f71cece tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:59.415964 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-e1bc56e1-c651-4b6e-beeb-e9285f71cece tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:59.416421 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-e1bc56e1-c651-4b6e-beeb-e9285f71cece tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:59.430971 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.wsgi [None req-e1bc56e1-c651-4b6e-beeb-e9285f71cece tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] HTTP exception thrown: Instance 6c8d44a3-c5aa-4d56-9a74-ad0c7b75cacc could not be found. Jun 30 12:42:59.432505 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-e1bc56e1-c651-4b6e-beeb-e9285f71cece tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Request method failure captured: Jun 30 12:42:59.432505 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: request: GET /compute/v2.1/servers/6c8d44a3-c5aa-4d56-9a74-ad0c7b75cacc HTTP/1.1 Jun 30 12:42:59.432505 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Accept: application/json Jun 30 12:42:59.432505 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Accept-Encoding: identity Jun 30 12:42:59.432505 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Connection: close Jun 30 12:42:59.432505 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Content-Length: 0 Jun 30 12:42:59.432505 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Content-Type: application/json Jun 30 12:42:59.432505 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Host: 10.222.0.57 Jun 30 12:42:59.432505 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Openstack-System-Scope: None Jun 30 12:42:59.432505 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: User-Agent: python-urllib3/1.26.9 Jun 30 12:42:59.432505 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Auth-Token: gAAAAABivZiCPNUV0kunj7abCRZKBEOSX_NBKR-P_YuEbI2MRrkPEtzdN_qWTKp6tAKx_HozBYA0Xvwhe_1LWzjKJlMRQsu9d7JGjn7xjw4fusXzSn0Ke-uIFi50icRYKg0NADR2TlaDwux5dqquUKh8n6yPiLjd2ZYPAhLeyVPik5UqOdEN7J4 Jun 30 12:42:59.432505 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Domain-Id: None Jun 30 12:42:59.432505 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Domain-Name: None Jun 30 12:42:59.432505 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Identity-Status: Confirmed Jun 30 12:42:59.432505 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Is-Admin-Project: True Jun 30 12:42:59.432505 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Domain-Id: default Jun 30 12:42:59.432505 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Domain-Name: Default Jun 30 12:42:59.432505 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Id: c7b272349089480984fd1c5eabe6dce9 Jun 30 12:42:59.432505 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Name: tempest-TestVolumeBootPattern-344479508 Jun 30 12:42:59.432505 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Role: member,reader Jun 30 12:42:59.432505 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Roles: member,reader Jun 30 12:42:59.434124 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c7b272349089480984fd1c5eabe6dce9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c7b272349089480984fd1c5eabe6dce9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c7b272349089480984fd1c5eabe6dce9", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c7b272349089480984fd1c5eabe6dce9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 30 12:42:59.434124 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant: tempest-TestVolumeBootPattern-344479508 Jun 30 12:42:59.434124 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant-Id: c7b272349089480984fd1c5eabe6dce9 Jun 30 12:42:59.434124 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant-Name: tempest-TestVolumeBootPattern-344479508 Jun 30 12:42:59.434124 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User: tempest-TestVolumeBootPattern-344479508-project Jun 30 12:42:59.434124 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Domain-Id: default Jun 30 12:42:59.434124 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Domain-Name: Default Jun 30 12:42:59.434124 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Id: 72419918d6c34080b6a4a4c73b2c06b2 Jun 30 12:42:59.434124 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Name: tempest-TestVolumeBootPattern-344479508-project Jun 30 12:42:59.434124 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: method: > Jun 30 12:42:59.434124 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: exception: Instance 6c8d44a3-c5aa-4d56-9a74-ad0c7b75cacc could not be found. Jun 30 12:42:59.434124 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: action_args: {'id': '6c8d44a3-c5aa-4d56-9a74-ad0c7b75cacc'} Jun 30 12:42:59.435087 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 12:42:59.435087 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:42:59.435087 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 12:42:59.435087 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 12:42:59.435087 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 12:42:59.435087 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 12:42:59.435087 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 12:42:59.435087 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 12:42:59.435087 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 12:42:59.435087 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 12:42:59.435087 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c8d44a3-c5aa-4d56-9a74-ad0c7b75cacc could not be found. Jun 30 12:42:59.435087 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:42:59.435087 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:42:59.435087 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:42:59.435087 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:42:59.435087 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:42:59.435087 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:42:59.435087 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 12:42:59.435087 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 12:42:59.435087 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 12:42:59.436725 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 12:42:59.436725 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 12:42:59.436725 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 12:42:59.436725 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 12:42:59.436725 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 12:42:59.436725 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 12:42:59.436725 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 12:42:59.436725 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c8d44a3-c5aa-4d56-9a74-ad0c7b75cacc could not be found. Jun 30 12:42:59.436725 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:42:59.436725 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:42:59.436725 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:42:59.436725 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:42:59.436725 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:42:59.436725 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:42:59.436725 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 12:42:59.436725 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 12:42:59.436725 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c8d44a3-c5aa-4d56-9a74-ad0c7b75cacc could not be found. Jun 30 12:42:59.436725 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:42:59.438178 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-e1bc56e1-c651-4b6e-beeb-e9285f71cece tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Returning 404 to user: Instance 6c8d44a3-c5aa-4d56-9a74-ad0c7b75cacc could not be found. {{(pid=124298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 12:42:59.438178 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-e1bc56e1-c651-4b6e-beeb-e9285f71cece tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] 10.222.0.57 "GET /compute/v2.1/servers/6c8d44a3-c5aa-4d56-9a74-ad0c7b75cacc" status: 404 len: 111 microversion: 2.1 time: 0.031737 Jun 30 12:42:59.439108 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 475/961] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:42:59 2022] GET /compute/v2.1/servers/6c8d44a3-c5aa-4d56-9a74-ad0c7b75cacc => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 12:42:59.498563 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-11705b48-9035-47c3-9dab-891df64e6eb2 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:42:59.499011 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-11705b48-9035-47c3-9dab-891df64e6eb2 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:42:59.507463 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-11705b48-9035-47c3-9dab-891df64e6eb2 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:59.508100 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-11705b48-9035-47c3-9dab-891df64e6eb2 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:59.509205 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-11705b48-9035-47c3-9dab-891df64e6eb2 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:42:59.509687 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-11705b48-9035-47c3-9dab-891df64e6eb2 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:42:59.652445 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-11705b48-9035-47c3-9dab-891df64e6eb2 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:59.661668 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-11705b48-9035-47c3-9dab-891df64e6eb2 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:59.663534 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-11705b48-9035-47c3-9dab-891df64e6eb2 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:42:59.664886 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-11705b48-9035-47c3-9dab-891df64e6eb2 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 200 len: 1723 microversion: 2.20 time: 0.171009 Jun 30 12:42:59.668713 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 487/962] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:42:59 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:42:59.939842 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-a4a1bead-3de3-4c88-a619-85e7df1bd45a tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Action: 'create', calling method: .version_select at 0x7fd0e008ca60>, body: {"keypair": {"name": "tempest-keypair-1884757416", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBgqmzWa+6AAGJItVBkH9g2H3FXLv205gYTSZRGisZtK2fov+An7mhANCx8ta5fdK0wRyHqv3l2T8/A8dAa6EK0KQtUtMOKLAcReTcflu84ux1GBYdyEvtxdqeOpXzMYnQ=="}} {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:42:59.954311 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.quota [None req-a4a1bead-3de3-4c88-a619-85e7df1bd45a tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Getting quotas for project 359201313a944a8fa9881ee6fdea67e2. Resources: {'key_pairs'} {{(pid=124298) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 12:42:59.958234 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.quota [None req-a4a1bead-3de3-4c88-a619-85e7df1bd45a tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Getting quotas for user e935f2637d124453947b3c78360567a5 and project 359201313a944a8fa9881ee6fdea67e2. Resources: {'key_pairs'} {{(pid=124298) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 12:42:59.984566 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-a4a1bead-3de3-4c88-a619-85e7df1bd45a tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048605 Jun 30 12:42:59.985325 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 476/963] 10.222.0.57 () {60 vars in 1158 bytes} [Thu Jun 30 12:42:59 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:43:00.683659 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-60c30848-0cee-4c95-a392-6317e1ae4b05 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:43:00.684894 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-60c30848-0cee-4c95-a392-6317e1ae4b05 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:43:00.692541 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-60c30848-0cee-4c95-a392-6317e1ae4b05 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:00.693030 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-60c30848-0cee-4c95-a392-6317e1ae4b05 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:00.693798 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-60c30848-0cee-4c95-a392-6317e1ae4b05 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:00.694227 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-60c30848-0cee-4c95-a392-6317e1ae4b05 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:00.898929 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-60c30848-0cee-4c95-a392-6317e1ae4b05 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:00.908886 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-60c30848-0cee-4c95-a392-6317e1ae4b05 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:00.911206 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-60c30848-0cee-4c95-a392-6317e1ae4b05 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:00.913025 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-60c30848-0cee-4c95-a392-6317e1ae4b05 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 200 len: 1723 microversion: 2.20 time: 0.233314 Jun 30 12:43:00.914299 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 488/964] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:43:00 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 1723 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:43:01.400030 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-34b71312-6945-404f-91c9-92d9fccaa8d4 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-315143169", "imageRef": "776a1662-a241-4e20-9a9c-e4743c64efd0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0cf7ba00-1ef8-492b-b4f6-ee883e3dfe65"}], "security_groups": [{"name": "tempest-securitygroup--555424667"}], "key_name": "tempest-keypair-1884757416", "user_data": "}} {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:43:01.506956 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.network.neutron [None req-34b71312-6945-404f-91c9-92d9fccaa8d4 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] validate_networks() for [('0cf7ba00-1ef8-492b-b4f6-ee883e3dfe65', None, None, None, None, None)] {{(pid=124298) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 12:43:01.913829 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.virt.hardware [None req-34b71312-6945-404f-91c9-92d9fccaa8d4 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Flavor limits 0:0:0 {{(pid=124298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 12:43:01.914281 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.virt.hardware [None req-34b71312-6945-404f-91c9-92d9fccaa8d4 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Image limits 0:0:0 {{(pid=124298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 12:43:01.914739 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.virt.hardware [None req-34b71312-6945-404f-91c9-92d9fccaa8d4 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Flavor pref 0:0:0 {{(pid=124298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 12:43:01.915480 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.virt.hardware [None req-34b71312-6945-404f-91c9-92d9fccaa8d4 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Image pref 0:0:0 {{(pid=124298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 12:43:01.915922 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.virt.hardware [None req-34b71312-6945-404f-91c9-92d9fccaa8d4 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 12:43:01.925486 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-34b71312-6945-404f-91c9-92d9fccaa8d4 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:01.925927 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-34b71312-6945-404f-91c9-92d9fccaa8d4 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:01.927125 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-34b71312-6945-404f-91c9-92d9fccaa8d4 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:01.927561 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-34b71312-6945-404f-91c9-92d9fccaa8d4 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:01.932148 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-3113d2eb-bbb7-48ec-8845-db773d6f4f80 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:43:01.932857 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-3113d2eb-bbb7-48ec-8845-db773d6f4f80 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:43:01.940564 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-3113d2eb-bbb7-48ec-8845-db773d6f4f80 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:01.941029 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-3113d2eb-bbb7-48ec-8845-db773d6f4f80 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:01.941937 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-3113d2eb-bbb7-48ec-8845-db773d6f4f80 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:01.942558 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-3113d2eb-bbb7-48ec-8845-db773d6f4f80 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:01.946232 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.quota [None req-34b71312-6945-404f-91c9-92d9fccaa8d4 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Getting quotas for project 359201313a944a8fa9881ee6fdea67e2. Resources: {'cores', 'ram', 'instances'} {{(pid=124298) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 12:43:01.952399 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.quota [None req-34b71312-6945-404f-91c9-92d9fccaa8d4 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Getting quotas for user e935f2637d124453947b3c78360567a5 and project 359201313a944a8fa9881ee6fdea67e2. Resources: {'cores', 'ram', 'instances'} {{(pid=124298) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 12:43:01.964854 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-34b71312-6945-404f-91c9-92d9fccaa8d4 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Going to run 1 instances... {{(pid=124298) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 12:43:01.967391 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-34b71312-6945-404f-91c9-92d9fccaa8d4 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: 18eee5c2-05c8-46c5-96b7-632f8130b2f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='776a1662-a241-4e20-9a9c-e4743c64efd0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124298) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 12:43:02.020965 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-34b71312-6945-404f-91c9-92d9fccaa8d4 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.626049 Jun 30 12:43:02.021786 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 477/965] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 30 12:43:01 2022] POST /compute/v2.1/servers => generated 401 bytes in 627 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 12:43:02.031956 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-d2bcdfad-a2ac-4cd5-b86a-2de0dc5ea2ca tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:43:02.032962 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-d2bcdfad-a2ac-4cd5-b86a-2de0dc5ea2ca tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: 18eee5c2-05c8-46c5-96b7-632f8130b2f7] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:43:02.117241 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-d2bcdfad-a2ac-4cd5-b86a-2de0dc5ea2ca tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e935f2637d124453947b3c78360567a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359201313a944a8fa9881ee6fdea67e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:02.128086 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-d2bcdfad-a2ac-4cd5-b86a-2de0dc5ea2ca tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "GET /compute/v2.1/servers/18eee5c2-05c8-46c5-96b7-632f8130b2f7" status: 200 len: 1241 microversion: 2.1 time: 0.099628 Jun 30 12:43:02.129379 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 478/966] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:43:02 2022] GET /compute/v2.1/servers/18eee5c2-05c8-46c5-96b7-632f8130b2f7 => generated 1241 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:43:02.133482 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-3113d2eb-bbb7-48ec-8845-db773d6f4f80 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:02.142874 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-3113d2eb-bbb7-48ec-8845-db773d6f4f80 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:02.144357 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-3113d2eb-bbb7-48ec-8845-db773d6f4f80 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:02.145565 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-3113d2eb-bbb7-48ec-8845-db773d6f4f80 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 200 len: 1723 microversion: 2.20 time: 0.217327 Jun 30 12:43:02.146299 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 489/967] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:43:01 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 1723 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 12:43:02.607497 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-bf55d330-f108-43dc-ba15-a8d98921747d tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:43:02.608043 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-bf55d330-f108-43dc-ba15-a8d98921747d tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] [instance: ad5ae807-1a12-48f7-b582-d2ffe80d6cb1] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:43:02.608987 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [req-68620506-5970-4344-aad9-999210e4911c req-83dbc90e-6029-458e-ba23-8e8508c51426 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad5ae807-1a12-48f7-b582-d2ffe80d6cb1", "tag": "6b9d37a9-15f5-46c2-b4ca-f8fa374974dd"}]} {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:43:02.618689 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [req-68620506-5970-4344-aad9-999210e4911c req-83dbc90e-6029-458e-ba23-8e8508c51426 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:02.618929 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-bf55d330-f108-43dc-ba15-a8d98921747d tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:02.619506 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-bf55d330-f108-43dc-ba15-a8d98921747d tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:02.619711 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [req-68620506-5970-4344-aad9-999210e4911c req-83dbc90e-6029-458e-ba23-8e8508c51426 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:02.620305 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-bf55d330-f108-43dc-ba15-a8d98921747d tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:02.621069 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-bf55d330-f108-43dc-ba15-a8d98921747d tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:02.631882 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.compute.server_external_events [req-68620506-5970-4344-aad9-999210e4911c req-83dbc90e-6029-458e-ba23-8e8508c51426 service nova] Creating event network-changed:6b9d37a9-15f5-46c2-b4ca-f8fa374974dd for instance ad5ae807-1a12-48f7-b582-d2ffe80d6cb1 on hv-cinder-84614 Jun 30 12:43:02.637187 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [req-68620506-5970-4344-aad9-999210e4911c req-83dbc90e-6029-458e-ba23-8e8508c51426 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032078 Jun 30 12:43:02.638153 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 490/968] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 30 12:43:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:43:02.664924 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-bf55d330-f108-43dc-ba15-a8d98921747d tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] [instance: ad5ae807-1a12-48f7-b582-d2ffe80d6cb1] Going to try to terminate instance {{(pid=124298) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 12:43:02.756847 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-bf55d330-f108-43dc-ba15-a8d98921747d tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] 10.222.0.57 "DELETE /compute/v2.1/servers/ad5ae807-1a12-48f7-b582-d2ffe80d6cb1" status: 204 len: 0 microversion: 2.1 time: 0.153053 Jun 30 12:43:02.757449 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 479/969] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 30 12:43:02 2022] DELETE /compute/v2.1/servers/ad5ae807-1a12-48f7-b582-d2ffe80d6cb1 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 12:43:02.766461 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-276e7455-a660-46ea-8454-f8b3145c6ce4 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:43:02.767253 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-276e7455-a660-46ea-8454-f8b3145c6ce4 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] [instance: ad5ae807-1a12-48f7-b582-d2ffe80d6cb1] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:43:02.774767 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-276e7455-a660-46ea-8454-f8b3145c6ce4 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:02.775199 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-276e7455-a660-46ea-8454-f8b3145c6ce4 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:02.776166 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-276e7455-a660-46ea-8454-f8b3145c6ce4 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:02.776613 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-276e7455-a660-46ea-8454-f8b3145c6ce4 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:02.911090 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-276e7455-a660-46ea-8454-f8b3145c6ce4 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72419918d6c34080b6a4a4c73b2c06b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b272349089480984fd1c5eabe6dce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:02.918656 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-276e7455-a660-46ea-8454-f8b3145c6ce4 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] 10.222.0.57 "GET /compute/v2.1/servers/ad5ae807-1a12-48f7-b582-d2ffe80d6cb1" status: 200 len: 1576 microversion: 2.1 time: 0.156698 Jun 30 12:43:02.919218 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 491/970] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:43:02 2022] GET /compute/v2.1/servers/ad5ae807-1a12-48f7-b582-d2ffe80d6cb1 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:43:03.146768 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-fc00aa08-4503-46eb-908a-b362f6060e5b tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:43:03.147933 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-fc00aa08-4503-46eb-908a-b362f6060e5b tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: 18eee5c2-05c8-46c5-96b7-632f8130b2f7] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:43:03.154377 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-fc00aa08-4503-46eb-908a-b362f6060e5b tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:03.154812 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-fc00aa08-4503-46eb-908a-b362f6060e5b tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:03.155577 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-fc00aa08-4503-46eb-908a-b362f6060e5b tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:03.155994 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-fc00aa08-4503-46eb-908a-b362f6060e5b tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:03.163907 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-8289e87d-a0bc-493a-acf8-01f5a07d75f3 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:43:03.165261 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-8289e87d-a0bc-493a-acf8-01f5a07d75f3 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:43:03.172934 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-8289e87d-a0bc-493a-acf8-01f5a07d75f3 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:03.173652 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-8289e87d-a0bc-493a-acf8-01f5a07d75f3 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:03.174408 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-8289e87d-a0bc-493a-acf8-01f5a07d75f3 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:03.175145 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-8289e87d-a0bc-493a-acf8-01f5a07d75f3 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:03.229742 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-fc00aa08-4503-46eb-908a-b362f6060e5b tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e935f2637d124453947b3c78360567a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359201313a944a8fa9881ee6fdea67e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:03.238246 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-fc00aa08-4503-46eb-908a-b362f6060e5b tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "GET /compute/v2.1/servers/18eee5c2-05c8-46c5-96b7-632f8130b2f7" status: 200 len: 1293 microversion: 2.1 time: 0.095674 Jun 30 12:43:03.239107 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 480/971] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:43:03 2022] GET /compute/v2.1/servers/18eee5c2-05c8-46c5-96b7-632f8130b2f7 => generated 1293 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 12:43:03.333133 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-8289e87d-a0bc-493a-acf8-01f5a07d75f3 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:03.341542 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-8289e87d-a0bc-493a-acf8-01f5a07d75f3 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:03.343039 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-8289e87d-a0bc-493a-acf8-01f5a07d75f3 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:03.344562 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-8289e87d-a0bc-493a-acf8-01f5a07d75f3 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 200 len: 1723 microversion: 2.20 time: 0.184562 Jun 30 12:43:03.345166 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 492/972] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:43:03 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:43:03.939158 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-34f7c3e2-7898-45e9-8cab-6f474a5bd17f tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:43:03.939763 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-34f7c3e2-7898-45e9-8cab-6f474a5bd17f tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] [instance: ad5ae807-1a12-48f7-b582-d2ffe80d6cb1] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:43:03.946835 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-34f7c3e2-7898-45e9-8cab-6f474a5bd17f tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:03.947283 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-34f7c3e2-7898-45e9-8cab-6f474a5bd17f tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:03.948046 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-34f7c3e2-7898-45e9-8cab-6f474a5bd17f tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:03.948480 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-34f7c3e2-7898-45e9-8cab-6f474a5bd17f tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:04.084722 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-34f7c3e2-7898-45e9-8cab-6f474a5bd17f tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72419918d6c34080b6a4a4c73b2c06b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b272349089480984fd1c5eabe6dce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:04.092398 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-34f7c3e2-7898-45e9-8cab-6f474a5bd17f tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] 10.222.0.57 "GET /compute/v2.1/servers/ad5ae807-1a12-48f7-b582-d2ffe80d6cb1" status: 200 len: 1576 microversion: 2.1 time: 0.159081 Jun 30 12:43:04.092995 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 481/973] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:43:03 2022] GET /compute/v2.1/servers/ad5ae807-1a12-48f7-b582-d2ffe80d6cb1 => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:43:04.256519 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-ec066a91-254d-4563-b71f-bef06a5539b4 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:43:04.257480 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-ec066a91-254d-4563-b71f-bef06a5539b4 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: 18eee5c2-05c8-46c5-96b7-632f8130b2f7] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:43:04.264303 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-ec066a91-254d-4563-b71f-bef06a5539b4 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:04.264785 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-ec066a91-254d-4563-b71f-bef06a5539b4 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:04.265913 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-ec066a91-254d-4563-b71f-bef06a5539b4 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:04.266647 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-ec066a91-254d-4563-b71f-bef06a5539b4 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:04.338326 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-ec066a91-254d-4563-b71f-bef06a5539b4 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e935f2637d124453947b3c78360567a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359201313a944a8fa9881ee6fdea67e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:04.346199 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-ec066a91-254d-4563-b71f-bef06a5539b4 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "GET /compute/v2.1/servers/18eee5c2-05c8-46c5-96b7-632f8130b2f7" status: 200 len: 1301 microversion: 2.1 time: 0.093652 Jun 30 12:43:04.346783 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 493/974] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:43:04 2022] GET /compute/v2.1/servers/18eee5c2-05c8-46c5-96b7-632f8130b2f7 => generated 1301 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:43:04.362913 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-d9807724-0eec-49df-8a5a-a56ecdeefef2 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:43:04.363646 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-d9807724-0eec-49df-8a5a-a56ecdeefef2 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:43:04.369678 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-d9807724-0eec-49df-8a5a-a56ecdeefef2 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:04.370126 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-d9807724-0eec-49df-8a5a-a56ecdeefef2 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:04.370927 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-d9807724-0eec-49df-8a5a-a56ecdeefef2 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:04.371365 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-d9807724-0eec-49df-8a5a-a56ecdeefef2 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:04.505425 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-d9807724-0eec-49df-8a5a-a56ecdeefef2 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:04.513958 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-d9807724-0eec-49df-8a5a-a56ecdeefef2 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:04.515298 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-d9807724-0eec-49df-8a5a-a56ecdeefef2 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:04.516559 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-d9807724-0eec-49df-8a5a-a56ecdeefef2 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 200 len: 1723 microversion: 2.20 time: 0.157716 Jun 30 12:43:04.517523 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 482/975] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:43:04 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:43:05.111136 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-18110bad-c6af-4098-9b52-3bdb791e0243 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:43:05.111749 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-18110bad-c6af-4098-9b52-3bdb791e0243 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] [instance: ad5ae807-1a12-48f7-b582-d2ffe80d6cb1] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:43:05.118466 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-18110bad-c6af-4098-9b52-3bdb791e0243 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:05.118890 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-18110bad-c6af-4098-9b52-3bdb791e0243 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:05.119933 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-18110bad-c6af-4098-9b52-3bdb791e0243 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:05.120367 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-18110bad-c6af-4098-9b52-3bdb791e0243 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:05.163498 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [req-cfd6360e-6968-4393-94f4-46f083b56da1 req-3a657912-d8bb-4228-9c58-a80b5e69e665 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad5ae807-1a12-48f7-b582-d2ffe80d6cb1", "name": "network-vif-deleted", "tag": "6b9d37a9-15f5-46c2-b4ca-f8fa374974dd"}]} {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:43:05.177893 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [req-cfd6360e-6968-4393-94f4-46f083b56da1 req-3a657912-d8bb-4228-9c58-a80b5e69e665 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:05.178647 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [req-cfd6360e-6968-4393-94f4-46f083b56da1 req-3a657912-d8bb-4228-9c58-a80b5e69e665 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:05.195362 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.compute.server_external_events [req-cfd6360e-6968-4393-94f4-46f083b56da1 req-3a657912-d8bb-4228-9c58-a80b5e69e665 service nova] Creating event network-vif-deleted:6b9d37a9-15f5-46c2-b4ca-f8fa374974dd for instance ad5ae807-1a12-48f7-b582-d2ffe80d6cb1 on hv-cinder-84614 Jun 30 12:43:05.204885 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [req-cfd6360e-6968-4393-94f4-46f083b56da1 req-3a657912-d8bb-4228-9c58-a80b5e69e665 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043663 Jun 30 12:43:05.205486 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-18110bad-c6af-4098-9b52-3bdb791e0243 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72419918d6c34080b6a4a4c73b2c06b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b272349089480984fd1c5eabe6dce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:05.205968 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 483/976] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 30 12:43:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 12:43:05.213612 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-18110bad-c6af-4098-9b52-3bdb791e0243 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] 10.222.0.57 "GET /compute/v2.1/servers/ad5ae807-1a12-48f7-b582-d2ffe80d6cb1" status: 200 len: 1391 microversion: 2.1 time: 0.106514 Jun 30 12:43:05.214190 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 494/977] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:43:05 2022] GET /compute/v2.1/servers/ad5ae807-1a12-48f7-b582-d2ffe80d6cb1 => generated 1391 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:43:05.363747 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-0c41d979-03a0-48c1-8de4-00347ce6464f tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:43:05.364823 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-0c41d979-03a0-48c1-8de4-00347ce6464f tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: 18eee5c2-05c8-46c5-96b7-632f8130b2f7] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:43:05.371658 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-0c41d979-03a0-48c1-8de4-00347ce6464f tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:05.372108 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-0c41d979-03a0-48c1-8de4-00347ce6464f tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:05.373575 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-0c41d979-03a0-48c1-8de4-00347ce6464f tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:05.374022 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-0c41d979-03a0-48c1-8de4-00347ce6464f tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:05.536330 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-27a7b1ba-1f91-44ac-9abd-8e5d14c8ae24 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:43:05.537240 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-27a7b1ba-1f91-44ac-9abd-8e5d14c8ae24 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:43:05.544581 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-0c41d979-03a0-48c1-8de4-00347ce6464f tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e935f2637d124453947b3c78360567a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359201313a944a8fa9881ee6fdea67e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:05.555101 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-0c41d979-03a0-48c1-8de4-00347ce6464f tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "GET /compute/v2.1/servers/18eee5c2-05c8-46c5-96b7-632f8130b2f7" status: 200 len: 1366 microversion: 2.1 time: 0.195831 Jun 30 12:43:05.555333 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-27a7b1ba-1f91-44ac-9abd-8e5d14c8ae24 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:05.555786 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-27a7b1ba-1f91-44ac-9abd-8e5d14c8ae24 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:05.556485 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 484/978] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:43:05 2022] GET /compute/v2.1/servers/18eee5c2-05c8-46c5-96b7-632f8130b2f7 => generated 1366 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:43:05.556861 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-27a7b1ba-1f91-44ac-9abd-8e5d14c8ae24 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:05.557379 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-27a7b1ba-1f91-44ac-9abd-8e5d14c8ae24 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:05.720813 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-27a7b1ba-1f91-44ac-9abd-8e5d14c8ae24 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:05.728915 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-27a7b1ba-1f91-44ac-9abd-8e5d14c8ae24 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:05.730344 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-27a7b1ba-1f91-44ac-9abd-8e5d14c8ae24 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:05.731561 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-27a7b1ba-1f91-44ac-9abd-8e5d14c8ae24 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 200 len: 1723 microversion: 2.20 time: 0.199842 Jun 30 12:43:05.732119 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 495/979] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:43:05 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 1723 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:43:06.098512 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [req-e477184d-576a-4ede-bea5-ee744325f69f req-f226b16d-b807-488c-aa4a-5280fba7d56b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18eee5c2-05c8-46c5-96b7-632f8130b2f7", "tag": "2f7f61d7-a608-4f6b-839c-937a066bca6e"}]} {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:43:06.108728 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [req-e477184d-576a-4ede-bea5-ee744325f69f req-f226b16d-b807-488c-aa4a-5280fba7d56b service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:06.109141 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [req-e477184d-576a-4ede-bea5-ee744325f69f req-f226b16d-b807-488c-aa4a-5280fba7d56b service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:06.124789 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.compute.server_external_events [req-e477184d-576a-4ede-bea5-ee744325f69f req-f226b16d-b807-488c-aa4a-5280fba7d56b service nova] Creating event network-changed:2f7f61d7-a608-4f6b-839c-937a066bca6e for instance 18eee5c2-05c8-46c5-96b7-632f8130b2f7 on hv-cinder-84614 Jun 30 12:43:06.130652 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [req-e477184d-576a-4ede-bea5-ee744325f69f req-f226b16d-b807-488c-aa4a-5280fba7d56b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037215 Jun 30 12:43:06.131328 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 485/980] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 30 12:43:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:43:06.231469 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-d29b1164-647b-4216-a6c2-3fd7c62fe29e tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:43:06.232357 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-d29b1164-647b-4216-a6c2-3fd7c62fe29e tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] [instance: ad5ae807-1a12-48f7-b582-d2ffe80d6cb1] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:43:06.240182 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-d29b1164-647b-4216-a6c2-3fd7c62fe29e tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:06.240663 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-d29b1164-647b-4216-a6c2-3fd7c62fe29e tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:06.241437 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-d29b1164-647b-4216-a6c2-3fd7c62fe29e tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:06.241866 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-d29b1164-647b-4216-a6c2-3fd7c62fe29e tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:06.258964 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.wsgi [None req-d29b1164-647b-4216-a6c2-3fd7c62fe29e tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] HTTP exception thrown: Instance ad5ae807-1a12-48f7-b582-d2ffe80d6cb1 could not be found. Jun 30 12:43:06.260954 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-d29b1164-647b-4216-a6c2-3fd7c62fe29e tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Request method failure captured: Jun 30 12:43:06.260954 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: request: GET /compute/v2.1/servers/ad5ae807-1a12-48f7-b582-d2ffe80d6cb1 HTTP/1.1 Jun 30 12:43:06.260954 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Accept: application/json Jun 30 12:43:06.260954 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Accept-Encoding: identity Jun 30 12:43:06.260954 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Connection: close Jun 30 12:43:06.260954 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Content-Length: 0 Jun 30 12:43:06.260954 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Content-Type: application/json Jun 30 12:43:06.260954 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Host: 10.222.0.57 Jun 30 12:43:06.260954 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Openstack-System-Scope: None Jun 30 12:43:06.260954 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: User-Agent: python-urllib3/1.26.9 Jun 30 12:43:06.260954 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Auth-Token: gAAAAABivZiCPNUV0kunj7abCRZKBEOSX_NBKR-P_YuEbI2MRrkPEtzdN_qWTKp6tAKx_HozBYA0Xvwhe_1LWzjKJlMRQsu9d7JGjn7xjw4fusXzSn0Ke-uIFi50icRYKg0NADR2TlaDwux5dqquUKh8n6yPiLjd2ZYPAhLeyVPik5UqOdEN7J4 Jun 30 12:43:06.260954 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Domain-Id: None Jun 30 12:43:06.260954 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Domain-Name: None Jun 30 12:43:06.260954 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Identity-Status: Confirmed Jun 30 12:43:06.260954 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Is-Admin-Project: True Jun 30 12:43:06.260954 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Project-Domain-Id: default Jun 30 12:43:06.260954 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Project-Domain-Name: Default Jun 30 12:43:06.260954 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Project-Id: c7b272349089480984fd1c5eabe6dce9 Jun 30 12:43:06.260954 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Project-Name: tempest-TestVolumeBootPattern-344479508 Jun 30 12:43:06.260954 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Role: member,reader Jun 30 12:43:06.260954 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Roles: member,reader Jun 30 12:43:06.262383 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c7b272349089480984fd1c5eabe6dce9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c7b272349089480984fd1c5eabe6dce9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c7b272349089480984fd1c5eabe6dce9", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c7b272349089480984fd1c5eabe6dce9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 30 12:43:06.262383 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Tenant: tempest-TestVolumeBootPattern-344479508 Jun 30 12:43:06.262383 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Tenant-Id: c7b272349089480984fd1c5eabe6dce9 Jun 30 12:43:06.262383 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Tenant-Name: tempest-TestVolumeBootPattern-344479508 Jun 30 12:43:06.262383 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User: tempest-TestVolumeBootPattern-344479508-project Jun 30 12:43:06.262383 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User-Domain-Id: default Jun 30 12:43:06.262383 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User-Domain-Name: Default Jun 30 12:43:06.262383 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User-Id: 72419918d6c34080b6a4a4c73b2c06b2 Jun 30 12:43:06.262383 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User-Name: tempest-TestVolumeBootPattern-344479508-project Jun 30 12:43:06.262383 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: method: > Jun 30 12:43:06.262383 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: exception: Instance ad5ae807-1a12-48f7-b582-d2ffe80d6cb1 could not be found. Jun 30 12:43:06.262383 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: action_args: {'id': 'ad5ae807-1a12-48f7-b582-d2ffe80d6cb1'} Jun 30 12:43:06.263199 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 12:43:06.263199 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:43:06.263199 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 12:43:06.263199 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 12:43:06.263199 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 12:43:06.263199 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 12:43:06.263199 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 12:43:06.263199 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 12:43:06.263199 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 12:43:06.263199 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 12:43:06.263199 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad5ae807-1a12-48f7-b582-d2ffe80d6cb1 could not be found. Jun 30 12:43:06.263199 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:43:06.263199 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:43:06.263199 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:43:06.263199 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:43:06.263199 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:43:06.263199 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:43:06.263199 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 12:43:06.263199 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 12:43:06.263199 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 12:43:06.264970 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 12:43:06.264970 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 12:43:06.264970 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 12:43:06.264970 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 12:43:06.264970 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 12:43:06.264970 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 12:43:06.264970 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 12:43:06.264970 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad5ae807-1a12-48f7-b582-d2ffe80d6cb1 could not be found. Jun 30 12:43:06.264970 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:43:06.264970 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:43:06.264970 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:43:06.264970 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:43:06.264970 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:43:06.264970 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:43:06.264970 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 12:43:06.264970 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 12:43:06.264970 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad5ae807-1a12-48f7-b582-d2ffe80d6cb1 could not be found. Jun 30 12:43:06.264970 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:43:06.267645 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-d29b1164-647b-4216-a6c2-3fd7c62fe29e tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Returning 404 to user: Instance ad5ae807-1a12-48f7-b582-d2ffe80d6cb1 could not be found. {{(pid=124297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 12:43:06.267645 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-d29b1164-647b-4216-a6c2-3fd7c62fe29e tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] 10.222.0.57 "GET /compute/v2.1/servers/ad5ae807-1a12-48f7-b582-d2ffe80d6cb1" status: 404 len: 111 microversion: 2.1 time: 0.034962 Jun 30 12:43:06.267645 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 496/981] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:43:06 2022] GET /compute/v2.1/servers/ad5ae807-1a12-48f7-b582-d2ffe80d6cb1 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 12:43:06.574778 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-9ece8d34-b87a-401d-937d-1501003ca956 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:43:06.575469 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-9ece8d34-b87a-401d-937d-1501003ca956 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: 18eee5c2-05c8-46c5-96b7-632f8130b2f7] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:43:06.581824 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-9ece8d34-b87a-401d-937d-1501003ca956 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:06.582261 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-9ece8d34-b87a-401d-937d-1501003ca956 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:06.583012 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-9ece8d34-b87a-401d-937d-1501003ca956 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:06.583642 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-9ece8d34-b87a-401d-937d-1501003ca956 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:06.751093 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-3efba05a-0ae3-487a-b49d-c4c33cf30b83 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:43:06.751681 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-3efba05a-0ae3-487a-b49d-c4c33cf30b83 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:43:06.759671 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-3efba05a-0ae3-487a-b49d-c4c33cf30b83 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:06.759671 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-3efba05a-0ae3-487a-b49d-c4c33cf30b83 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:06.759977 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-3efba05a-0ae3-487a-b49d-c4c33cf30b83 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:06.760219 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-3efba05a-0ae3-487a-b49d-c4c33cf30b83 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:06.794098 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-9ece8d34-b87a-401d-937d-1501003ca956 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e935f2637d124453947b3c78360567a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359201313a944a8fa9881ee6fdea67e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:06.801902 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-9ece8d34-b87a-401d-937d-1501003ca956 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "GET /compute/v2.1/servers/18eee5c2-05c8-46c5-96b7-632f8130b2f7" status: 200 len: 1366 microversion: 2.1 time: 0.231818 Jun 30 12:43:06.802431 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 486/982] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:43:06 2022] GET /compute/v2.1/servers/18eee5c2-05c8-46c5-96b7-632f8130b2f7 => generated 1366 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:43:06.807036 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-4b671b24-d11e-4848-bf04-3590f5cf1156 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:43:06.807525 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-4b671b24-d11e-4848-bf04-3590f5cf1156 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] [instance: 42333613-46ed-4609-bb89-b0e3e7358ea0] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:43:06.813917 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-4b671b24-d11e-4848-bf04-3590f5cf1156 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:06.814358 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-4b671b24-d11e-4848-bf04-3590f5cf1156 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:06.815118 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-4b671b24-d11e-4848-bf04-3590f5cf1156 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:06.815542 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-4b671b24-d11e-4848-bf04-3590f5cf1156 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:06.829166 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.wsgi [None req-4b671b24-d11e-4848-bf04-3590f5cf1156 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] HTTP exception thrown: Instance 42333613-46ed-4609-bb89-b0e3e7358ea0 could not be found. Jun 30 12:43:06.830845 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-4b671b24-d11e-4848-bf04-3590f5cf1156 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Request method failure captured: Jun 30 12:43:06.830845 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: request: DELETE /compute/v2.1/servers/42333613-46ed-4609-bb89-b0e3e7358ea0 HTTP/1.1 Jun 30 12:43:06.830845 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Accept: application/json Jun 30 12:43:06.830845 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Accept-Encoding: identity Jun 30 12:43:06.830845 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Connection: close Jun 30 12:43:06.830845 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Content-Length: 0 Jun 30 12:43:06.830845 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Content-Type: application/json Jun 30 12:43:06.830845 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Host: 10.222.0.57 Jun 30 12:43:06.830845 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Openstack-System-Scope: None Jun 30 12:43:06.830845 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: User-Agent: python-urllib3/1.26.9 Jun 30 12:43:06.830845 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Auth-Token: gAAAAABivZiCPNUV0kunj7abCRZKBEOSX_NBKR-P_YuEbI2MRrkPEtzdN_qWTKp6tAKx_HozBYA0Xvwhe_1LWzjKJlMRQsu9d7JGjn7xjw4fusXzSn0Ke-uIFi50icRYKg0NADR2TlaDwux5dqquUKh8n6yPiLjd2ZYPAhLeyVPik5UqOdEN7J4 Jun 30 12:43:06.830845 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Domain-Id: None Jun 30 12:43:06.830845 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Domain-Name: None Jun 30 12:43:06.830845 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Identity-Status: Confirmed Jun 30 12:43:06.830845 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Is-Admin-Project: True Jun 30 12:43:06.830845 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Domain-Id: default Jun 30 12:43:06.830845 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Domain-Name: Default Jun 30 12:43:06.830845 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Id: c7b272349089480984fd1c5eabe6dce9 Jun 30 12:43:06.830845 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Name: tempest-TestVolumeBootPattern-344479508 Jun 30 12:43:06.830845 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Role: member,reader Jun 30 12:43:06.830845 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Roles: member,reader Jun 30 12:43:06.832287 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c7b272349089480984fd1c5eabe6dce9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c7b272349089480984fd1c5eabe6dce9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c7b272349089480984fd1c5eabe6dce9", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c7b272349089480984fd1c5eabe6dce9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 30 12:43:06.832287 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant: tempest-TestVolumeBootPattern-344479508 Jun 30 12:43:06.832287 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant-Id: c7b272349089480984fd1c5eabe6dce9 Jun 30 12:43:06.832287 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant-Name: tempest-TestVolumeBootPattern-344479508 Jun 30 12:43:06.832287 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User: tempest-TestVolumeBootPattern-344479508-project Jun 30 12:43:06.832287 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Domain-Id: default Jun 30 12:43:06.832287 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Domain-Name: Default Jun 30 12:43:06.832287 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Id: 72419918d6c34080b6a4a4c73b2c06b2 Jun 30 12:43:06.832287 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Name: tempest-TestVolumeBootPattern-344479508-project Jun 30 12:43:06.832287 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: method: > Jun 30 12:43:06.832287 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: exception: Instance 42333613-46ed-4609-bb89-b0e3e7358ea0 could not be found. Jun 30 12:43:06.832287 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: action_args: {'id': '42333613-46ed-4609-bb89-b0e3e7358ea0'} Jun 30 12:43:06.833108 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 12:43:06.833108 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:43:06.833108 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 12:43:06.833108 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 12:43:06.833108 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 12:43:06.833108 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 12:43:06.833108 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 12:43:06.833108 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 12:43:06.833108 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 12:43:06.833108 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 12:43:06.833108 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42333613-46ed-4609-bb89-b0e3e7358ea0 could not be found. Jun 30 12:43:06.833108 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:43:06.833108 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:43:06.833108 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:43:06.833108 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:43:06.833108 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:43:06.833108 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:43:06.833108 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 12:43:06.833108 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 12:43:06.833108 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 12:43:06.834402 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 12:43:06.834402 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 30 12:43:06.834402 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 30 12:43:06.834402 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 30 12:43:06.834402 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 30 12:43:06.834402 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 12:43:06.834402 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 12:43:06.834402 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 12:43:06.834402 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 12:43:06.834402 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42333613-46ed-4609-bb89-b0e3e7358ea0 could not be found. Jun 30 12:43:06.834402 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:43:06.834402 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:43:06.834402 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:43:06.834402 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:43:06.834402 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:43:06.834402 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:43:06.834402 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 12:43:06.834402 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 12:43:06.834402 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42333613-46ed-4609-bb89-b0e3e7358ea0 could not be found. Jun 30 12:43:06.834402 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:43:06.835650 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-4b671b24-d11e-4848-bf04-3590f5cf1156 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Returning 404 to user: Instance 42333613-46ed-4609-bb89-b0e3e7358ea0 could not be found. {{(pid=124298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 12:43:06.835650 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-4b671b24-d11e-4848-bf04-3590f5cf1156 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] 10.222.0.57 "DELETE /compute/v2.1/servers/42333613-46ed-4609-bb89-b0e3e7358ea0" status: 404 len: 111 microversion: 2.1 time: 0.028708 Jun 30 12:43:06.835650 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 487/983] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 30 12:43:06 2022] DELETE /compute/v2.1/servers/42333613-46ed-4609-bb89-b0e3e7358ea0 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 12:43:06.840411 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-dedee9a7-e8cc-48c7-b114-94272cf13d44 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:43:06.841043 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-dedee9a7-e8cc-48c7-b114-94272cf13d44 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] [instance: 42333613-46ed-4609-bb89-b0e3e7358ea0] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:43:06.847807 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-dedee9a7-e8cc-48c7-b114-94272cf13d44 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:06.848254 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-dedee9a7-e8cc-48c7-b114-94272cf13d44 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:06.849032 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-dedee9a7-e8cc-48c7-b114-94272cf13d44 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:06.849461 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-dedee9a7-e8cc-48c7-b114-94272cf13d44 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:06.863665 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.wsgi [None req-dedee9a7-e8cc-48c7-b114-94272cf13d44 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] HTTP exception thrown: Instance 42333613-46ed-4609-bb89-b0e3e7358ea0 could not be found. Jun 30 12:43:06.865265 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-dedee9a7-e8cc-48c7-b114-94272cf13d44 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Request method failure captured: Jun 30 12:43:06.865265 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: request: GET /compute/v2.1/servers/42333613-46ed-4609-bb89-b0e3e7358ea0 HTTP/1.1 Jun 30 12:43:06.865265 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Accept: application/json Jun 30 12:43:06.865265 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Accept-Encoding: identity Jun 30 12:43:06.865265 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Connection: close Jun 30 12:43:06.865265 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Content-Length: 0 Jun 30 12:43:06.865265 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Content-Type: application/json Jun 30 12:43:06.865265 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Host: 10.222.0.57 Jun 30 12:43:06.865265 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Openstack-System-Scope: None Jun 30 12:43:06.865265 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: User-Agent: python-urllib3/1.26.9 Jun 30 12:43:06.865265 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Auth-Token: gAAAAABivZiCPNUV0kunj7abCRZKBEOSX_NBKR-P_YuEbI2MRrkPEtzdN_qWTKp6tAKx_HozBYA0Xvwhe_1LWzjKJlMRQsu9d7JGjn7xjw4fusXzSn0Ke-uIFi50icRYKg0NADR2TlaDwux5dqquUKh8n6yPiLjd2ZYPAhLeyVPik5UqOdEN7J4 Jun 30 12:43:06.865265 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Domain-Id: None Jun 30 12:43:06.865265 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Domain-Name: None Jun 30 12:43:06.865265 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Identity-Status: Confirmed Jun 30 12:43:06.865265 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Is-Admin-Project: True Jun 30 12:43:06.865265 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Domain-Id: default Jun 30 12:43:06.865265 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Domain-Name: Default Jun 30 12:43:06.865265 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Id: c7b272349089480984fd1c5eabe6dce9 Jun 30 12:43:06.865265 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Name: tempest-TestVolumeBootPattern-344479508 Jun 30 12:43:06.865265 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Role: member,reader Jun 30 12:43:06.865265 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Roles: member,reader Jun 30 12:43:06.866840 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c7b272349089480984fd1c5eabe6dce9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c7b272349089480984fd1c5eabe6dce9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c7b272349089480984fd1c5eabe6dce9", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c7b272349089480984fd1c5eabe6dce9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 30 12:43:06.866840 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant: tempest-TestVolumeBootPattern-344479508 Jun 30 12:43:06.866840 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant-Id: c7b272349089480984fd1c5eabe6dce9 Jun 30 12:43:06.866840 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant-Name: tempest-TestVolumeBootPattern-344479508 Jun 30 12:43:06.866840 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User: tempest-TestVolumeBootPattern-344479508-project Jun 30 12:43:06.866840 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Domain-Id: default Jun 30 12:43:06.866840 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Domain-Name: Default Jun 30 12:43:06.866840 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Id: 72419918d6c34080b6a4a4c73b2c06b2 Jun 30 12:43:06.866840 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Name: tempest-TestVolumeBootPattern-344479508-project Jun 30 12:43:06.866840 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: method: > Jun 30 12:43:06.866840 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: exception: Instance 42333613-46ed-4609-bb89-b0e3e7358ea0 could not be found. Jun 30 12:43:06.866840 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: action_args: {'id': '42333613-46ed-4609-bb89-b0e3e7358ea0'} Jun 30 12:43:06.867739 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 12:43:06.867739 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:43:06.867739 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 12:43:06.867739 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 12:43:06.867739 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 12:43:06.867739 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 12:43:06.867739 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 12:43:06.867739 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 12:43:06.867739 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 12:43:06.867739 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 12:43:06.867739 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42333613-46ed-4609-bb89-b0e3e7358ea0 could not be found. Jun 30 12:43:06.867739 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:43:06.867739 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:43:06.867739 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:43:06.867739 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:43:06.867739 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:43:06.867739 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:43:06.867739 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 12:43:06.867739 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 12:43:06.867739 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 12:43:06.869206 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 12:43:06.869206 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 12:43:06.869206 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 12:43:06.869206 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 12:43:06.869206 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 12:43:06.869206 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 12:43:06.869206 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 12:43:06.869206 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42333613-46ed-4609-bb89-b0e3e7358ea0 could not be found. Jun 30 12:43:06.869206 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:43:06.869206 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:43:06.869206 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:43:06.869206 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:43:06.869206 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:43:06.869206 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:43:06.869206 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 12:43:06.869206 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 12:43:06.869206 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42333613-46ed-4609-bb89-b0e3e7358ea0 could not be found. Jun 30 12:43:06.869206 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:43:06.871243 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-dedee9a7-e8cc-48c7-b114-94272cf13d44 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Returning 404 to user: Instance 42333613-46ed-4609-bb89-b0e3e7358ea0 could not be found. {{(pid=124298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 12:43:06.871243 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-dedee9a7-e8cc-48c7-b114-94272cf13d44 tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] 10.222.0.57 "GET /compute/v2.1/servers/42333613-46ed-4609-bb89-b0e3e7358ea0" status: 404 len: 111 microversion: 2.1 time: 0.029807 Jun 30 12:43:06.871243 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 488/984] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:43:06 2022] GET /compute/v2.1/servers/42333613-46ed-4609-bb89-b0e3e7358ea0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 30 12:43:06.905483 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-3efba05a-0ae3-487a-b49d-c4c33cf30b83 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:06.914055 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-3efba05a-0ae3-487a-b49d-c4c33cf30b83 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:06.915533 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-3efba05a-0ae3-487a-b49d-c4c33cf30b83 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:06.916780 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-3efba05a-0ae3-487a-b49d-c4c33cf30b83 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 200 len: 1723 microversion: 2.20 time: 0.170145 Jun 30 12:43:06.917336 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 497/985] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:43:06 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:43:07.819313 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-8d4161ca-e836-4fc4-85fb-e6084a298039 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:43:07.819912 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-8d4161ca-e836-4fc4-85fb-e6084a298039 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: 18eee5c2-05c8-46c5-96b7-632f8130b2f7] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:43:07.827188 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-8d4161ca-e836-4fc4-85fb-e6084a298039 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:07.827648 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-8d4161ca-e836-4fc4-85fb-e6084a298039 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:07.828412 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-8d4161ca-e836-4fc4-85fb-e6084a298039 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:07.828888 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-8d4161ca-e836-4fc4-85fb-e6084a298039 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:07.935572 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-bf7c6842-852a-4920-b838-ad7a5714e0f5 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:43:07.936185 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-bf7c6842-852a-4920-b838-ad7a5714e0f5 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:43:07.943728 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-bf7c6842-852a-4920-b838-ad7a5714e0f5 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:07.944268 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-bf7c6842-852a-4920-b838-ad7a5714e0f5 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:07.945143 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-bf7c6842-852a-4920-b838-ad7a5714e0f5 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:07.945658 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-bf7c6842-852a-4920-b838-ad7a5714e0f5 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:07.965402 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-8d4161ca-e836-4fc4-85fb-e6084a298039 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e935f2637d124453947b3c78360567a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359201313a944a8fa9881ee6fdea67e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:07.973025 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-8d4161ca-e836-4fc4-85fb-e6084a298039 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "GET /compute/v2.1/servers/18eee5c2-05c8-46c5-96b7-632f8130b2f7" status: 200 len: 1366 microversion: 2.1 time: 0.157651 Jun 30 12:43:07.973582 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 489/986] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:43:07 2022] GET /compute/v2.1/servers/18eee5c2-05c8-46c5-96b7-632f8130b2f7 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:43:08.124935 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-bf7c6842-852a-4920-b838-ad7a5714e0f5 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:08.133722 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-bf7c6842-852a-4920-b838-ad7a5714e0f5 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:08.135215 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-bf7c6842-852a-4920-b838-ad7a5714e0f5 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:08.136392 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-bf7c6842-852a-4920-b838-ad7a5714e0f5 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 200 len: 1723 microversion: 2.20 time: 0.204778 Jun 30 12:43:08.137009 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 498/987] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:43:07 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 1723 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:43:08.221929 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-be6cb8be-5abd-4f0b-bc40-a99bf70c387b tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] Calling method '.version_select at 0x7fd0e00a7790>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:43:08.233746 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG dbcounter [-] [124298] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=124298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:43:08.243646 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-be6cb8be-5abd-4f0b-bc40-a99bf70c387b tempest-TestVolumeBootPattern-344479508 tempest-TestVolumeBootPattern-344479508-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1101131035" status: 202 len: 0 microversion: 2.1 time: 0.025852 Jun 30 12:43:08.244215 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 490/988] 10.222.0.57 () {58 vars in 1262 bytes} [Thu Jun 30 12:43:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1101131035 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 12:43:08.990265 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-f49a3d33-838a-4142-831c-4951f4980554 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:43:08.990817 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-f49a3d33-838a-4142-831c-4951f4980554 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: 18eee5c2-05c8-46c5-96b7-632f8130b2f7] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:43:08.997952 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-f49a3d33-838a-4142-831c-4951f4980554 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:08.998476 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-f49a3d33-838a-4142-831c-4951f4980554 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:08.999245 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-f49a3d33-838a-4142-831c-4951f4980554 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:08.999678 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-f49a3d33-838a-4142-831c-4951f4980554 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:09.156417 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-2293cc44-4f5f-4e0f-8439-413bad53809c tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:43:09.157143 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-2293cc44-4f5f-4e0f-8439-413bad53809c tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:43:09.163293 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-2293cc44-4f5f-4e0f-8439-413bad53809c tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:09.163763 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-2293cc44-4f5f-4e0f-8439-413bad53809c tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:09.164534 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-2293cc44-4f5f-4e0f-8439-413bad53809c tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:09.164979 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-2293cc44-4f5f-4e0f-8439-413bad53809c tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:09.226990 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-f49a3d33-838a-4142-831c-4951f4980554 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e935f2637d124453947b3c78360567a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359201313a944a8fa9881ee6fdea67e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:09.234576 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-f49a3d33-838a-4142-831c-4951f4980554 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "GET /compute/v2.1/servers/18eee5c2-05c8-46c5-96b7-632f8130b2f7" status: 200 len: 1366 microversion: 2.1 time: 0.248366 Jun 30 12:43:09.235105 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 499/989] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:43:08 2022] GET /compute/v2.1/servers/18eee5c2-05c8-46c5-96b7-632f8130b2f7 => generated 1366 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:43:09.367917 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-2293cc44-4f5f-4e0f-8439-413bad53809c tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:09.376098 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-2293cc44-4f5f-4e0f-8439-413bad53809c tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:09.378225 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-2293cc44-4f5f-4e0f-8439-413bad53809c tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:09.379383 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-2293cc44-4f5f-4e0f-8439-413bad53809c tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 200 len: 1723 microversion: 2.20 time: 0.227965 Jun 30 12:43:09.379955 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 491/990] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:43:09 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 1723 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:43:10.251469 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-acb0c7a0-6fa8-4f0b-9326-c4274c9972a9 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:43:10.252792 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-acb0c7a0-6fa8-4f0b-9326-c4274c9972a9 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: 18eee5c2-05c8-46c5-96b7-632f8130b2f7] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:43:10.264035 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-acb0c7a0-6fa8-4f0b-9326-c4274c9972a9 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:10.264483 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-acb0c7a0-6fa8-4f0b-9326-c4274c9972a9 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:10.265296 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-acb0c7a0-6fa8-4f0b-9326-c4274c9972a9 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:10.267689 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-acb0c7a0-6fa8-4f0b-9326-c4274c9972a9 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:10.399232 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-3be28031-7f4f-4d93-9168-f961bd99393d tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:43:10.399847 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-3be28031-7f4f-4d93-9168-f961bd99393d tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:43:10.406473 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-3be28031-7f4f-4d93-9168-f961bd99393d tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:10.406919 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-3be28031-7f4f-4d93-9168-f961bd99393d tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:10.408126 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-3be28031-7f4f-4d93-9168-f961bd99393d tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:10.408844 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-3be28031-7f4f-4d93-9168-f961bd99393d tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:10.424371 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG dbcounter [-] [124298] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:43:10.469692 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-acb0c7a0-6fa8-4f0b-9326-c4274c9972a9 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e935f2637d124453947b3c78360567a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359201313a944a8fa9881ee6fdea67e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:10.478432 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-acb0c7a0-6fa8-4f0b-9326-c4274c9972a9 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "GET /compute/v2.1/servers/18eee5c2-05c8-46c5-96b7-632f8130b2f7" status: 200 len: 1366 microversion: 2.1 time: 0.230814 Jun 30 12:43:10.488167 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 500/991] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:43:10 2022] GET /compute/v2.1/servers/18eee5c2-05c8-46c5-96b7-632f8130b2f7 => generated 1366 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:43:10.645590 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-3be28031-7f4f-4d93-9168-f961bd99393d tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:10.655131 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-3be28031-7f4f-4d93-9168-f961bd99393d tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:10.657567 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-3be28031-7f4f-4d93-9168-f961bd99393d tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:10.658832 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-3be28031-7f4f-4d93-9168-f961bd99393d tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 200 len: 1723 microversion: 2.20 time: 0.264085 Jun 30 12:43:10.659359 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 492/992] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:43:10 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 1723 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 12:43:11.499638 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-01472b5a-ed1e-4862-900b-e1d8511cfdbe tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:43:11.500253 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-01472b5a-ed1e-4862-900b-e1d8511cfdbe tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: 18eee5c2-05c8-46c5-96b7-632f8130b2f7] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:43:11.507173 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-01472b5a-ed1e-4862-900b-e1d8511cfdbe tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:11.507640 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-01472b5a-ed1e-4862-900b-e1d8511cfdbe tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:11.508436 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-01472b5a-ed1e-4862-900b-e1d8511cfdbe tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:11.508887 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-01472b5a-ed1e-4862-900b-e1d8511cfdbe tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:11.679312 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-7e01cc7c-df55-4cdf-8ddd-7c0ee37b6ca5 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:43:11.679997 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-7e01cc7c-df55-4cdf-8ddd-7c0ee37b6ca5 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:43:11.687684 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-7e01cc7c-df55-4cdf-8ddd-7c0ee37b6ca5 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:11.688936 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-7e01cc7c-df55-4cdf-8ddd-7c0ee37b6ca5 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:11.690882 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-7e01cc7c-df55-4cdf-8ddd-7c0ee37b6ca5 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:11.691734 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-7e01cc7c-df55-4cdf-8ddd-7c0ee37b6ca5 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:11.792909 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-01472b5a-ed1e-4862-900b-e1d8511cfdbe tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e935f2637d124453947b3c78360567a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359201313a944a8fa9881ee6fdea67e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:11.817020 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-01472b5a-ed1e-4862-900b-e1d8511cfdbe tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "GET /compute/v2.1/servers/18eee5c2-05c8-46c5-96b7-632f8130b2f7" status: 200 len: 1366 microversion: 2.1 time: 0.324480 Jun 30 12:43:11.818506 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 501/993] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:43:11 2022] GET /compute/v2.1/servers/18eee5c2-05c8-46c5-96b7-632f8130b2f7 => generated 1366 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:43:11.936170 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG dbcounter [-] [124298] Writing DB stats nova_cell0:SELECT=2 {{(pid=124298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:43:11.943793 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-7e01cc7c-df55-4cdf-8ddd-7c0ee37b6ca5 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:11.951796 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-7e01cc7c-df55-4cdf-8ddd-7c0ee37b6ca5 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:11.953297 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-7e01cc7c-df55-4cdf-8ddd-7c0ee37b6ca5 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:11.954462 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-7e01cc7c-df55-4cdf-8ddd-7c0ee37b6ca5 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 200 len: 1723 microversion: 2.20 time: 0.280045 Jun 30 12:43:11.955596 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 493/994] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:43:11 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 1723 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:43:11.996153 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [req-ef4462f1-bb81-43fb-af24-391c467e6194 req-f3ee3f5c-0c37-4d7e-b8da-29f0f8ceff15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18eee5c2-05c8-46c5-96b7-632f8130b2f7", "name": "network-vif-plugged", "status": "completed", "tag": "2f7f61d7-a608-4f6b-839c-937a066bca6e"}]} {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:43:12.005427 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [req-ef4462f1-bb81-43fb-af24-391c467e6194 req-f3ee3f5c-0c37-4d7e-b8da-29f0f8ceff15 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:12.005956 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [req-ef4462f1-bb81-43fb-af24-391c467e6194 req-f3ee3f5c-0c37-4d7e-b8da-29f0f8ceff15 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:12.017847 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.compute.server_external_events [req-ef4462f1-bb81-43fb-af24-391c467e6194 req-f3ee3f5c-0c37-4d7e-b8da-29f0f8ceff15 service nova] Creating event network-vif-plugged:2f7f61d7-a608-4f6b-839c-937a066bca6e for instance 18eee5c2-05c8-46c5-96b7-632f8130b2f7 on hv-cinder-84614 Jun 30 12:43:12.023247 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [req-ef4462f1-bb81-43fb-af24-391c467e6194 req-f3ee3f5c-0c37-4d7e-b8da-29f0f8ceff15 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031772 Jun 30 12:43:12.024346 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 502/995] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 30 12:43:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:43:12.835590 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-203a4ffe-9289-4927-b92c-b4dec9efbceb tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:43:12.836215 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-203a4ffe-9289-4927-b92c-b4dec9efbceb tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: 18eee5c2-05c8-46c5-96b7-632f8130b2f7] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:43:12.838154 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG dbcounter [-] [124298] Writing DB stats nova_cell0:SELECT=12 {{(pid=124298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:43:12.844476 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-203a4ffe-9289-4927-b92c-b4dec9efbceb tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:12.844943 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-203a4ffe-9289-4927-b92c-b4dec9efbceb tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:12.845802 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-203a4ffe-9289-4927-b92c-b4dec9efbceb tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:12.846324 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-203a4ffe-9289-4927-b92c-b4dec9efbceb tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:12.974786 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-1f5e0fee-04a9-4cb3-9655-c63fb314b385 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:43:12.975580 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-1f5e0fee-04a9-4cb3-9655-c63fb314b385 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:43:12.982543 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-1f5e0fee-04a9-4cb3-9655-c63fb314b385 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:12.983029 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-1f5e0fee-04a9-4cb3-9655-c63fb314b385 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:12.983806 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-1f5e0fee-04a9-4cb3-9655-c63fb314b385 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:12.984241 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-1f5e0fee-04a9-4cb3-9655-c63fb314b385 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:12.984855 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-203a4ffe-9289-4927-b92c-b4dec9efbceb tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e935f2637d124453947b3c78360567a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359201313a944a8fa9881ee6fdea67e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:12.992939 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-203a4ffe-9289-4927-b92c-b4dec9efbceb tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "GET /compute/v2.1/servers/18eee5c2-05c8-46c5-96b7-632f8130b2f7" status: 200 len: 1366 microversion: 2.1 time: 0.161279 Jun 30 12:43:12.993608 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 494/996] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:43:12 2022] GET /compute/v2.1/servers/18eee5c2-05c8-46c5-96b7-632f8130b2f7 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:43:13.118963 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-1f5e0fee-04a9-4cb3-9655-c63fb314b385 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:13.127201 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-1f5e0fee-04a9-4cb3-9655-c63fb314b385 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:13.128921 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-1f5e0fee-04a9-4cb3-9655-c63fb314b385 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:13.130107 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-1f5e0fee-04a9-4cb3-9655-c63fb314b385 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 200 len: 1723 microversion: 2.20 time: 0.160477 Jun 30 12:43:13.130649 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 503/997] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:43:12 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:43:14.010340 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-75da01f8-3fbf-475d-bee2-e1d9912d7a5e tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:43:14.011284 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-75da01f8-3fbf-475d-bee2-e1d9912d7a5e tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: 18eee5c2-05c8-46c5-96b7-632f8130b2f7] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:43:14.018630 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-75da01f8-3fbf-475d-bee2-e1d9912d7a5e tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:14.019354 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-75da01f8-3fbf-475d-bee2-e1d9912d7a5e tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:14.020193 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-75da01f8-3fbf-475d-bee2-e1d9912d7a5e tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:14.020843 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-75da01f8-3fbf-475d-bee2-e1d9912d7a5e tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:14.148579 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-cd9ec3cb-32ef-4d95-ad72-5bffcafbb21a tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:43:14.149278 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-cd9ec3cb-32ef-4d95-ad72-5bffcafbb21a tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:43:14.155820 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-cd9ec3cb-32ef-4d95-ad72-5bffcafbb21a tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:14.156271 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-cd9ec3cb-32ef-4d95-ad72-5bffcafbb21a tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:14.157085 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-cd9ec3cb-32ef-4d95-ad72-5bffcafbb21a tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:14.157694 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-cd9ec3cb-32ef-4d95-ad72-5bffcafbb21a tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:14.171941 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-75da01f8-3fbf-475d-bee2-e1d9912d7a5e tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e935f2637d124453947b3c78360567a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359201313a944a8fa9881ee6fdea67e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:14.180084 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-75da01f8-3fbf-475d-bee2-e1d9912d7a5e tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "GET /compute/v2.1/servers/18eee5c2-05c8-46c5-96b7-632f8130b2f7" status: 200 len: 1555 microversion: 2.1 time: 0.173747 Jun 30 12:43:14.191190 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 495/998] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:43:14 2022] GET /compute/v2.1/servers/18eee5c2-05c8-46c5-96b7-632f8130b2f7 => generated 1555 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:43:14.197228 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-6fd2687e-371c-4f49-a853-253e0cc5b381 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:43:14.197722 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-6fd2687e-371c-4f49-a853-253e0cc5b381 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: 18eee5c2-05c8-46c5-96b7-632f8130b2f7] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:43:14.203980 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-6fd2687e-371c-4f49-a853-253e0cc5b381 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:14.204437 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-6fd2687e-371c-4f49-a853-253e0cc5b381 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:14.205285 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-6fd2687e-371c-4f49-a853-253e0cc5b381 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:14.205782 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-6fd2687e-371c-4f49-a853-253e0cc5b381 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:14.308872 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-6fd2687e-371c-4f49-a853-253e0cc5b381 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "GET /compute/v2.1/servers/18eee5c2-05c8-46c5-96b7-632f8130b2f7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.116036 Jun 30 12:43:14.311154 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 496/999] 10.222.0.57 () {58 vars in 1274 bytes} [Thu Jun 30 12:43:14 2022] GET /compute/v2.1/servers/18eee5c2-05c8-46c5-96b7-632f8130b2f7/os-interface => generated 284 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:43:14.457357 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-cd9ec3cb-32ef-4d95-ad72-5bffcafbb21a tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:14.470105 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-cd9ec3cb-32ef-4d95-ad72-5bffcafbb21a tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:14.471924 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-cd9ec3cb-32ef-4d95-ad72-5bffcafbb21a tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:14.473150 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-cd9ec3cb-32ef-4d95-ad72-5bffcafbb21a tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 200 len: 1723 microversion: 2.20 time: 0.329562 Jun 30 12:43:14.473701 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 504/1000] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:43:14 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 1723 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:43:15.491925 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-3ca49b65-802f-44fe-81c8-76c5f5f21b3d tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:43:15.492529 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-3ca49b65-802f-44fe-81c8-76c5f5f21b3d tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:43:15.506550 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-3ca49b65-802f-44fe-81c8-76c5f5f21b3d tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:15.507090 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-3ca49b65-802f-44fe-81c8-76c5f5f21b3d tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:15.507951 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-3ca49b65-802f-44fe-81c8-76c5f5f21b3d tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:15.508480 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-3ca49b65-802f-44fe-81c8-76c5f5f21b3d tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:15.827490 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-3ca49b65-802f-44fe-81c8-76c5f5f21b3d tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:15.836796 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-3ca49b65-802f-44fe-81c8-76c5f5f21b3d tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:15.838293 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-3ca49b65-802f-44fe-81c8-76c5f5f21b3d tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:15.839468 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-3ca49b65-802f-44fe-81c8-76c5f5f21b3d tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 200 len: 1723 microversion: 2.20 time: 0.351638 Jun 30 12:43:15.840034 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 497/1001] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:43:15 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 1723 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 12:43:15.967656 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [req-3640f56d-435e-4325-b766-d507a13c57fd req-1272b663-4e8c-48ba-b162-ac58d9477f9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18eee5c2-05c8-46c5-96b7-632f8130b2f7", "tag": "2f7f61d7-a608-4f6b-839c-937a066bca6e"}]} {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:43:15.972468 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG dbcounter [-] [124297] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=124297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:43:15.978260 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [req-3640f56d-435e-4325-b766-d507a13c57fd req-1272b663-4e8c-48ba-b162-ac58d9477f9c service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:15.978961 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [req-3640f56d-435e-4325-b766-d507a13c57fd req-1272b663-4e8c-48ba-b162-ac58d9477f9c service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:15.995004 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG dbcounter [-] [124297] Writing DB stats nova_cell1:SELECT=100 {{(pid=124297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:43:15.997491 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.compute.server_external_events [req-3640f56d-435e-4325-b766-d507a13c57fd req-1272b663-4e8c-48ba-b162-ac58d9477f9c service nova] Creating event network-changed:2f7f61d7-a608-4f6b-839c-937a066bca6e for instance 18eee5c2-05c8-46c5-96b7-632f8130b2f7 on hv-cinder-84614 Jun 30 12:43:16.004377 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [req-3640f56d-435e-4325-b766-d507a13c57fd req-1272b663-4e8c-48ba-b162-ac58d9477f9c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040254 Jun 30 12:43:16.005661 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 505/1002] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 30 12:43:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:43:16.858296 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-9c73cbc3-944f-46aa-b2c5-9a7c6a3adc28 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:43:16.858906 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-9c73cbc3-944f-46aa-b2c5-9a7c6a3adc28 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:43:16.868295 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-9c73cbc3-944f-46aa-b2c5-9a7c6a3adc28 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:16.868739 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-9c73cbc3-944f-46aa-b2c5-9a7c6a3adc28 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:16.869527 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-9c73cbc3-944f-46aa-b2c5-9a7c6a3adc28 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:16.869955 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-9c73cbc3-944f-46aa-b2c5-9a7c6a3adc28 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:17.018054 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-9c73cbc3-944f-46aa-b2c5-9a7c6a3adc28 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:17.027089 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-9c73cbc3-944f-46aa-b2c5-9a7c6a3adc28 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:17.028585 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-9c73cbc3-944f-46aa-b2c5-9a7c6a3adc28 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:17.029810 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-9c73cbc3-944f-46aa-b2c5-9a7c6a3adc28 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 200 len: 1744 microversion: 2.20 time: 0.175810 Jun 30 12:43:17.030537 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 498/1003] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:43:16 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 1744 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:43:18.050902 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-f3cfbfed-b20c-47c4-add3-6ce9c4726df9 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:43:18.050902 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-f3cfbfed-b20c-47c4-add3-6ce9c4726df9 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:43:18.058703 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-f3cfbfed-b20c-47c4-add3-6ce9c4726df9 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:18.059140 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-f3cfbfed-b20c-47c4-add3-6ce9c4726df9 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:18.059937 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-f3cfbfed-b20c-47c4-add3-6ce9c4726df9 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:18.060370 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-f3cfbfed-b20c-47c4-add3-6ce9c4726df9 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:18.214411 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-f3cfbfed-b20c-47c4-add3-6ce9c4726df9 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:18.223727 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-f3cfbfed-b20c-47c4-add3-6ce9c4726df9 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:18.225349 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-f3cfbfed-b20c-47c4-add3-6ce9c4726df9 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:18.226945 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-f3cfbfed-b20c-47c4-add3-6ce9c4726df9 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 200 len: 1744 microversion: 2.20 time: 0.182545 Jun 30 12:43:18.227756 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 506/1004] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:43:18 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 1744 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:43:19.247073 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-9122a70d-f4ca-49b9-8c08-f30c81486c00 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:43:19.247650 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-9122a70d-f4ca-49b9-8c08-f30c81486c00 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:43:19.255120 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-9122a70d-f4ca-49b9-8c08-f30c81486c00 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:19.255569 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-9122a70d-f4ca-49b9-8c08-f30c81486c00 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:19.256333 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-9122a70d-f4ca-49b9-8c08-f30c81486c00 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:19.257063 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-9122a70d-f4ca-49b9-8c08-f30c81486c00 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:19.398631 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-9122a70d-f4ca-49b9-8c08-f30c81486c00 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:19.407285 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-9122a70d-f4ca-49b9-8c08-f30c81486c00 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:19.409422 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-9122a70d-f4ca-49b9-8c08-f30c81486c00 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:19.410983 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-9122a70d-f4ca-49b9-8c08-f30c81486c00 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 200 len: 1739 microversion: 2.20 time: 0.167955 Jun 30 12:43:19.411547 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 499/1005] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:43:19 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 1739 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 12:43:19.922418 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [req-890deb16-9c90-48b7-aff2-3aec5367612e req-a3c8458f-858b-4069-b7e8-2cc3fc111d42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c79b3b73-522e-4636-bd99-234f910f3999", "name": "network-vif-plugged", "status": "completed", "tag": "89638ae7-46a1-4d58-af0e-071e8bafd6b4"}]} {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:43:19.933660 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [req-890deb16-9c90-48b7-aff2-3aec5367612e req-a3c8458f-858b-4069-b7e8-2cc3fc111d42 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:19.934340 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [req-890deb16-9c90-48b7-aff2-3aec5367612e req-a3c8458f-858b-4069-b7e8-2cc3fc111d42 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:19.949826 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.compute.server_external_events [req-890deb16-9c90-48b7-aff2-3aec5367612e req-a3c8458f-858b-4069-b7e8-2cc3fc111d42 service nova] Creating event network-vif-plugged:89638ae7-46a1-4d58-af0e-071e8bafd6b4 for instance c79b3b73-522e-4636-bd99-234f910f3999 on hv-cinder-84614 Jun 30 12:43:19.955887 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [req-890deb16-9c90-48b7-aff2-3aec5367612e req-a3c8458f-858b-4069-b7e8-2cc3fc111d42 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037798 Jun 30 12:43:19.956885 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 507/1006] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 30 12:43:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:43:20.430179 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-e72bd33f-e70c-4ed4-a1e4-df2b4fedc0c1 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:43:20.431544 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-e72bd33f-e70c-4ed4-a1e4-df2b4fedc0c1 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:43:20.438923 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-e72bd33f-e70c-4ed4-a1e4-df2b4fedc0c1 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:20.439368 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-e72bd33f-e70c-4ed4-a1e4-df2b4fedc0c1 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:20.440859 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-e72bd33f-e70c-4ed4-a1e4-df2b4fedc0c1 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:20.441600 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-e72bd33f-e70c-4ed4-a1e4-df2b4fedc0c1 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:20.597125 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-e72bd33f-e70c-4ed4-a1e4-df2b4fedc0c1 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:20.605745 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-e72bd33f-e70c-4ed4-a1e4-df2b4fedc0c1 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:20.607299 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-e72bd33f-e70c-4ed4-a1e4-df2b4fedc0c1 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:20.608724 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-e72bd33f-e70c-4ed4-a1e4-df2b4fedc0c1 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 200 len: 1739 microversion: 2.20 time: 0.182734 Jun 30 12:43:20.609795 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 500/1007] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:43:20 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 1739 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:43:21.629051 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-f596adfc-8d98-42b6-8de5-7c6593416c30 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:43:21.630579 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-f596adfc-8d98-42b6-8de5-7c6593416c30 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:43:21.637391 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-f596adfc-8d98-42b6-8de5-7c6593416c30 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:21.638068 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-f596adfc-8d98-42b6-8de5-7c6593416c30 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:21.639423 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-f596adfc-8d98-42b6-8de5-7c6593416c30 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:21.639586 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-f596adfc-8d98-42b6-8de5-7c6593416c30 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:21.794309 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-f596adfc-8d98-42b6-8de5-7c6593416c30 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:21.803012 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-f596adfc-8d98-42b6-8de5-7c6593416c30 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:21.804651 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-f596adfc-8d98-42b6-8de5-7c6593416c30 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:21.805932 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-f596adfc-8d98-42b6-8de5-7c6593416c30 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 200 len: 1739 microversion: 2.20 time: 0.181810 Jun 30 12:43:21.813071 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 508/1008] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:43:21 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 1739 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:43:22.823953 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-d2d78bba-48cb-4e26-b5dc-2c7c75c92d45 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:43:22.825230 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-d2d78bba-48cb-4e26-b5dc-2c7c75c92d45 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:43:22.834974 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-d2d78bba-48cb-4e26-b5dc-2c7c75c92d45 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:22.835737 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-d2d78bba-48cb-4e26-b5dc-2c7c75c92d45 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:22.836802 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-d2d78bba-48cb-4e26-b5dc-2c7c75c92d45 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:22.837304 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-d2d78bba-48cb-4e26-b5dc-2c7c75c92d45 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:22.989203 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-d2d78bba-48cb-4e26-b5dc-2c7c75c92d45 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:22.997967 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-d2d78bba-48cb-4e26-b5dc-2c7c75c92d45 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:22.999547 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-d2d78bba-48cb-4e26-b5dc-2c7c75c92d45 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:23.000836 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-d2d78bba-48cb-4e26-b5dc-2c7c75c92d45 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 200 len: 1739 microversion: 2.20 time: 0.180811 Jun 30 12:43:23.009012 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 501/1009] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:43:22 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 1739 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:43:24.019706 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-0158fa4d-6386-4f69-97cb-ef59dd13ce7b tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:43:24.021082 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-0158fa4d-6386-4f69-97cb-ef59dd13ce7b tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:43:24.028761 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-0158fa4d-6386-4f69-97cb-ef59dd13ce7b tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:24.029208 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-0158fa4d-6386-4f69-97cb-ef59dd13ce7b tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:24.029992 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-0158fa4d-6386-4f69-97cb-ef59dd13ce7b tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:24.030431 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-0158fa4d-6386-4f69-97cb-ef59dd13ce7b tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:24.176021 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-0158fa4d-6386-4f69-97cb-ef59dd13ce7b tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:24.185397 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-0158fa4d-6386-4f69-97cb-ef59dd13ce7b tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:24.187335 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-0158fa4d-6386-4f69-97cb-ef59dd13ce7b tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:24.188506 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-0158fa4d-6386-4f69-97cb-ef59dd13ce7b tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 200 len: 1739 microversion: 2.20 time: 0.173220 Jun 30 12:43:24.201247 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 509/1010] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:43:24 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 1739 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:43:25.215872 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-cdb94ef1-5c37-4b94-8cb8-e9a0455b1a09 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:43:25.216536 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-cdb94ef1-5c37-4b94-8cb8-e9a0455b1a09 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:43:25.225437 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-cdb94ef1-5c37-4b94-8cb8-e9a0455b1a09 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:25.225889 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-cdb94ef1-5c37-4b94-8cb8-e9a0455b1a09 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:25.226671 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-cdb94ef1-5c37-4b94-8cb8-e9a0455b1a09 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:25.227114 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-cdb94ef1-5c37-4b94-8cb8-e9a0455b1a09 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:25.386979 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-cdb94ef1-5c37-4b94-8cb8-e9a0455b1a09 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:25.395953 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-cdb94ef1-5c37-4b94-8cb8-e9a0455b1a09 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:25.398277 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-cdb94ef1-5c37-4b94-8cb8-e9a0455b1a09 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:25.399714 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-cdb94ef1-5c37-4b94-8cb8-e9a0455b1a09 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 200 len: 1739 microversion: 2.20 time: 0.187968 Jun 30 12:43:25.400510 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 502/1011] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:43:25 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 1739 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:43:26.420076 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-bea932ca-4f57-44ad-b0e8-7f91ef96b619 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:43:26.420811 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-bea932ca-4f57-44ad-b0e8-7f91ef96b619 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:43:26.427788 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-bea932ca-4f57-44ad-b0e8-7f91ef96b619 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:26.428591 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-bea932ca-4f57-44ad-b0e8-7f91ef96b619 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:26.429402 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-bea932ca-4f57-44ad-b0e8-7f91ef96b619 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:26.429836 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-bea932ca-4f57-44ad-b0e8-7f91ef96b619 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:26.579643 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-bea932ca-4f57-44ad-b0e8-7f91ef96b619 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:26.591276 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-bea932ca-4f57-44ad-b0e8-7f91ef96b619 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:26.592796 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-bea932ca-4f57-44ad-b0e8-7f91ef96b619 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:26.593998 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-bea932ca-4f57-44ad-b0e8-7f91ef96b619 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 200 len: 1739 microversion: 2.20 time: 0.179382 Jun 30 12:43:26.606508 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 510/1012] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:43:26 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 1739 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:43:27.618609 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-6dc900ed-9161-4492-a1ff-40f52ecfe9f5 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:43:27.619461 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-6dc900ed-9161-4492-a1ff-40f52ecfe9f5 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:43:27.629900 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-6dc900ed-9161-4492-a1ff-40f52ecfe9f5 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:27.630362 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-6dc900ed-9161-4492-a1ff-40f52ecfe9f5 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:27.631134 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-6dc900ed-9161-4492-a1ff-40f52ecfe9f5 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:27.631576 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-6dc900ed-9161-4492-a1ff-40f52ecfe9f5 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:27.777249 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-6dc900ed-9161-4492-a1ff-40f52ecfe9f5 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:27.786125 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-6dc900ed-9161-4492-a1ff-40f52ecfe9f5 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:27.787637 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-6dc900ed-9161-4492-a1ff-40f52ecfe9f5 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:27.788853 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-6dc900ed-9161-4492-a1ff-40f52ecfe9f5 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 200 len: 1721 microversion: 2.20 time: 0.176930 Jun 30 12:43:27.789380 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 503/1013] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:43:27 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 1721 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:43:28.809759 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-038aed31-1db7-4a46-800e-89ea299b7eec tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:43:28.810427 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-038aed31-1db7-4a46-800e-89ea299b7eec tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:43:28.819440 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-038aed31-1db7-4a46-800e-89ea299b7eec tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:28.819992 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-038aed31-1db7-4a46-800e-89ea299b7eec tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:28.820986 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-038aed31-1db7-4a46-800e-89ea299b7eec tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:28.821531 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-038aed31-1db7-4a46-800e-89ea299b7eec tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:28.965312 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-038aed31-1db7-4a46-800e-89ea299b7eec tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:28.977865 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-038aed31-1db7-4a46-800e-89ea299b7eec tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:28.980064 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-038aed31-1db7-4a46-800e-89ea299b7eec tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:28.981820 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-038aed31-1db7-4a46-800e-89ea299b7eec tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 200 len: 1721 microversion: 2.20 time: 0.176923 Jun 30 12:43:28.982589 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 511/1014] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:43:28 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 1721 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:43:30.003752 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-005f9800-2755-46b4-bf47-727a9ca152c5 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:43:30.004741 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-005f9800-2755-46b4-bf47-727a9ca152c5 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:43:30.011405 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-005f9800-2755-46b4-bf47-727a9ca152c5 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:30.011854 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-005f9800-2755-46b4-bf47-727a9ca152c5 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:30.012606 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-005f9800-2755-46b4-bf47-727a9ca152c5 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:30.013067 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-005f9800-2755-46b4-bf47-727a9ca152c5 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:30.155908 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-005f9800-2755-46b4-bf47-727a9ca152c5 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:30.164340 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-005f9800-2755-46b4-bf47-727a9ca152c5 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:30.165914 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-005f9800-2755-46b4-bf47-727a9ca152c5 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:30.167100 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-005f9800-2755-46b4-bf47-727a9ca152c5 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 200 len: 1721 microversion: 2.20 time: 0.169549 Jun 30 12:43:30.167700 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 504/1015] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:43:29 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:43:31.185712 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-641dc377-d322-4778-8fa5-dd95573ceecc tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:43:31.186360 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-641dc377-d322-4778-8fa5-dd95573ceecc tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:43:31.193040 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-641dc377-d322-4778-8fa5-dd95573ceecc tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:31.193573 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-641dc377-d322-4778-8fa5-dd95573ceecc tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:31.194256 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-641dc377-d322-4778-8fa5-dd95573ceecc tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:31.194728 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-641dc377-d322-4778-8fa5-dd95573ceecc tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:31.331202 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-641dc377-d322-4778-8fa5-dd95573ceecc tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:31.343603 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-641dc377-d322-4778-8fa5-dd95573ceecc tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:31.345955 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-641dc377-d322-4778-8fa5-dd95573ceecc tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:31.347719 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-641dc377-d322-4778-8fa5-dd95573ceecc tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 200 len: 1664 microversion: 2.20 time: 0.165684 Jun 30 12:43:31.348470 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 512/1016] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:43:31 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 1664 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:43:31.366090 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-0d8927c4-b284-4678-9c94-cbabaa23a975 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fa63831d-0c43-4a3b-b87c-a2595cc43ba5"}} {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:43:31.367174 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-0d8927c4-b284-4678-9c94-cbabaa23a975 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:43:31.373896 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-0d8927c4-b284-4678-9c94-cbabaa23a975 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:31.374346 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-0d8927c4-b284-4678-9c94-cbabaa23a975 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:31.375103 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-0d8927c4-b284-4678-9c94-cbabaa23a975 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:31.375538 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-0d8927c4-b284-4678-9c94-cbabaa23a975 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:31.690765 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-0d8927c4-b284-4678-9c94-cbabaa23a975 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "POST /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.328809 Jun 30 12:43:31.691481 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 505/1017] 10.222.0.57 () {62 vars in 1363 bytes} [Thu Jun 30 12:43:31 2022] POST /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999/os-volume_attachments => generated 188 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 12:43:31.821080 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-17d2371c-3ebe-4d00-8d78-665be4331305 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:43:31.821558 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-17d2371c-3ebe-4d00-8d78-665be4331305 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:43:31.827754 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-17d2371c-3ebe-4d00-8d78-665be4331305 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:31.828211 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-17d2371c-3ebe-4d00-8d78-665be4331305 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:31.829005 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-17d2371c-3ebe-4d00-8d78-665be4331305 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:31.829437 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-17d2371c-3ebe-4d00-8d78-665be4331305 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:31.949862 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [req-0f5b1c71-df53-44f9-8233-ba41f7d27caa req-ebefce34-15d2-4e20-b354-699731a9bd16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c79b3b73-522e-4636-bd99-234f910f3999", "name": "network-vif-unplugged", "status": "completed", "tag": "89638ae7-46a1-4d58-af0e-071e8bafd6b4"}]} {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:43:31.959570 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [req-0f5b1c71-df53-44f9-8233-ba41f7d27caa req-ebefce34-15d2-4e20-b354-699731a9bd16 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:31.960122 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [req-0f5b1c71-df53-44f9-8233-ba41f7d27caa req-ebefce34-15d2-4e20-b354-699731a9bd16 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:31.972017 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.compute.server_external_events [req-0f5b1c71-df53-44f9-8233-ba41f7d27caa req-ebefce34-15d2-4e20-b354-699731a9bd16 service nova] Unable to find a host for instance c79b3b73-522e-4636-bd99-234f910f3999. Dropping event network-vif-unplugged {{(pid=124298) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 30 12:43:31.973002 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [req-0f5b1c71-df53-44f9-8233-ba41f7d27caa req-ebefce34-15d2-4e20-b354-699731a9bd16 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030291 Jun 30 12:43:31.973668 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 506/1018] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 30 12:43:31 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 30 12:43:32.089416 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-17d2371c-3ebe-4d00-8d78-665be4331305 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "DELETE /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999/os-volume_attachments/fa63831d-0c43-4a3b-b87c-a2595cc43ba5" status: 202 len: 0 microversion: 2.20 time: 0.272388 Jun 30 12:43:32.090019 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 513/1019] 10.222.0.57 () {60 vars in 1456 bytes} [Thu Jun 30 12:43:31 2022] DELETE /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999/os-volume_attachments/fa63831d-0c43-4a3b-b87c-a2595cc43ba5 => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 30 12:43:32.149056 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-ada2cde1-a31f-470f-a214-b1e224740891 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:43:32.149615 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-ada2cde1-a31f-470f-a214-b1e224740891 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:43:32.155927 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-ada2cde1-a31f-470f-a214-b1e224740891 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:32.156376 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-ada2cde1-a31f-470f-a214-b1e224740891 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:32.157181 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-ada2cde1-a31f-470f-a214-b1e224740891 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:32.157612 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-ada2cde1-a31f-470f-a214-b1e224740891 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:32.171404 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG dbcounter [-] [124298] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=124298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:43:32.360902 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-ada2cde1-a31f-470f-a214-b1e224740891 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "POST /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999/action" status: 202 len: 0 microversion: 2.20 time: 0.215826 Jun 30 12:43:32.361434 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 507/1020] 10.222.0.57 () {62 vars in 1318 bytes} [Thu Jun 30 12:43:32 2022] POST /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 30 12:43:32.370153 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-82522142-6fa3-4199-994c-9379604b00ca tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:43:32.370766 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-82522142-6fa3-4199-994c-9379604b00ca tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:43:32.378483 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-82522142-6fa3-4199-994c-9379604b00ca tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:32.378939 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-82522142-6fa3-4199-994c-9379604b00ca tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:32.379759 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-82522142-6fa3-4199-994c-9379604b00ca tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:32.380242 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-82522142-6fa3-4199-994c-9379604b00ca tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:32.517714 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-82522142-6fa3-4199-994c-9379604b00ca tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:32.526328 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-82522142-6fa3-4199-994c-9379604b00ca tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:32.527821 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-82522142-6fa3-4199-994c-9379604b00ca tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:32.529057 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-82522142-6fa3-4199-994c-9379604b00ca tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 200 len: 1672 microversion: 2.20 time: 0.162896 Jun 30 12:43:32.529648 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 514/1021] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:43:32 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 1672 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:43:33.549997 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-74f68fce-2d36-41d5-bba0-2c69d5d19510 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:43:33.550798 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-74f68fce-2d36-41d5-bba0-2c69d5d19510 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:43:33.562506 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-74f68fce-2d36-41d5-bba0-2c69d5d19510 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:33.563105 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-74f68fce-2d36-41d5-bba0-2c69d5d19510 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:33.564126 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-74f68fce-2d36-41d5-bba0-2c69d5d19510 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:33.564752 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-74f68fce-2d36-41d5-bba0-2c69d5d19510 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:33.708538 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-74f68fce-2d36-41d5-bba0-2c69d5d19510 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:33.716657 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-74f68fce-2d36-41d5-bba0-2c69d5d19510 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:33.718178 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-74f68fce-2d36-41d5-bba0-2c69d5d19510 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:33.719352 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-74f68fce-2d36-41d5-bba0-2c69d5d19510 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 200 len: 1730 microversion: 2.20 time: 0.174779 Jun 30 12:43:33.719940 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 508/1022] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:43:33 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:43:34.738685 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-2140f449-e105-4c45-b8d6-861ecdc73b7a tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:43:34.740331 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-2140f449-e105-4c45-b8d6-861ecdc73b7a tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:43:34.749014 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-2140f449-e105-4c45-b8d6-861ecdc73b7a tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:34.750372 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-2140f449-e105-4c45-b8d6-861ecdc73b7a tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:34.752121 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-2140f449-e105-4c45-b8d6-861ecdc73b7a tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:34.752866 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-2140f449-e105-4c45-b8d6-861ecdc73b7a tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:34.947593 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-2140f449-e105-4c45-b8d6-861ecdc73b7a tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:34.967129 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-2140f449-e105-4c45-b8d6-861ecdc73b7a tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:34.969092 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-2140f449-e105-4c45-b8d6-861ecdc73b7a tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:34.970405 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-2140f449-e105-4c45-b8d6-861ecdc73b7a tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 200 len: 1730 microversion: 2.20 time: 0.236139 Jun 30 12:43:34.971788 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 515/1023] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:43:34 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 1730 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:43:35.991269 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-aa371bc2-bb1a-4a78-a0e7-2b0d25ca3afb tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:43:35.991943 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-aa371bc2-bb1a-4a78-a0e7-2b0d25ca3afb tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:43:35.999560 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-aa371bc2-bb1a-4a78-a0e7-2b0d25ca3afb tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:35.999997 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-aa371bc2-bb1a-4a78-a0e7-2b0d25ca3afb tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:36.000991 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-aa371bc2-bb1a-4a78-a0e7-2b0d25ca3afb tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:36.001458 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-aa371bc2-bb1a-4a78-a0e7-2b0d25ca3afb tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:36.160449 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-aa371bc2-bb1a-4a78-a0e7-2b0d25ca3afb tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:36.169851 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-aa371bc2-bb1a-4a78-a0e7-2b0d25ca3afb tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:36.171360 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-aa371bc2-bb1a-4a78-a0e7-2b0d25ca3afb tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:36.172533 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-aa371bc2-bb1a-4a78-a0e7-2b0d25ca3afb tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 200 len: 1730 microversion: 2.20 time: 0.185712 Jun 30 12:43:36.173125 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 509/1024] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:43:35 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 1730 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:43:37.191693 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-d268f737-e714-4cbf-8e26-9a6e9c923604 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:43:37.192353 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-d268f737-e714-4cbf-8e26-9a6e9c923604 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:43:37.199479 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-d268f737-e714-4cbf-8e26-9a6e9c923604 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:37.200061 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-d268f737-e714-4cbf-8e26-9a6e9c923604 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:37.200979 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-d268f737-e714-4cbf-8e26-9a6e9c923604 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:37.201415 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-d268f737-e714-4cbf-8e26-9a6e9c923604 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:37.343478 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-d268f737-e714-4cbf-8e26-9a6e9c923604 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:37.351845 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-d268f737-e714-4cbf-8e26-9a6e9c923604 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:37.353380 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-d268f737-e714-4cbf-8e26-9a6e9c923604 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:37.354675 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-d268f737-e714-4cbf-8e26-9a6e9c923604 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 200 len: 1730 microversion: 2.20 time: 0.167138 Jun 30 12:43:37.355466 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 516/1025] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:43:37 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:43:38.373889 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-8f7aa7a3-e9e4-4f36-8d34-ff217df717ce tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:43:38.374730 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-8f7aa7a3-e9e4-4f36-8d34-ff217df717ce tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:43:38.381840 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-8f7aa7a3-e9e4-4f36-8d34-ff217df717ce tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:38.382388 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-8f7aa7a3-e9e4-4f36-8d34-ff217df717ce tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:38.383270 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-8f7aa7a3-e9e4-4f36-8d34-ff217df717ce tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:38.383756 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-8f7aa7a3-e9e4-4f36-8d34-ff217df717ce tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:38.531626 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-8f7aa7a3-e9e4-4f36-8d34-ff217df717ce tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:38.540026 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-8f7aa7a3-e9e4-4f36-8d34-ff217df717ce tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:38.541538 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-8f7aa7a3-e9e4-4f36-8d34-ff217df717ce tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:38.542708 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-8f7aa7a3-e9e4-4f36-8d34-ff217df717ce tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 200 len: 1730 microversion: 2.20 time: 0.172868 Jun 30 12:43:38.543651 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 510/1026] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:43:38 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:43:39.561896 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-dfd0ec1b-170b-4e81-9e45-31262589aa95 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:43:39.562520 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-dfd0ec1b-170b-4e81-9e45-31262589aa95 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:43:39.570428 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-dfd0ec1b-170b-4e81-9e45-31262589aa95 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:39.570882 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-dfd0ec1b-170b-4e81-9e45-31262589aa95 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:39.571684 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-dfd0ec1b-170b-4e81-9e45-31262589aa95 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:39.572133 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-dfd0ec1b-170b-4e81-9e45-31262589aa95 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:39.722478 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-dfd0ec1b-170b-4e81-9e45-31262589aa95 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:39.733243 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-dfd0ec1b-170b-4e81-9e45-31262589aa95 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:39.734752 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-dfd0ec1b-170b-4e81-9e45-31262589aa95 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:39.736016 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-dfd0ec1b-170b-4e81-9e45-31262589aa95 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 200 len: 1730 microversion: 2.20 time: 0.178144 Jun 30 12:43:39.746993 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 517/1027] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:43:39 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 1730 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:43:40.755654 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-16ee278e-a49f-45e9-8008-1aa75d0090bd tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:43:40.756283 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-16ee278e-a49f-45e9-8008-1aa75d0090bd tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:43:40.758693 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG dbcounter [-] [124298] Writing DB stats nova_api:DELETE=1,nova_api:SELECT=43 {{(pid=124298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:43:40.764732 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-16ee278e-a49f-45e9-8008-1aa75d0090bd tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:40.765183 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-16ee278e-a49f-45e9-8008-1aa75d0090bd tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:40.770915 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-16ee278e-a49f-45e9-8008-1aa75d0090bd tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:40.771506 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-16ee278e-a49f-45e9-8008-1aa75d0090bd tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:40.919986 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-16ee278e-a49f-45e9-8008-1aa75d0090bd tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:40.928842 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-16ee278e-a49f-45e9-8008-1aa75d0090bd tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:40.930338 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-16ee278e-a49f-45e9-8008-1aa75d0090bd tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:40.931535 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-16ee278e-a49f-45e9-8008-1aa75d0090bd tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 200 len: 1730 microversion: 2.20 time: 0.179887 Jun 30 12:43:40.932236 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 511/1028] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:43:40 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 1730 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:43:41.950468 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-66f58769-9c88-4a8a-aa08-3e20f82b0383 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:43:41.951149 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-66f58769-9c88-4a8a-aa08-3e20f82b0383 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:43:41.958047 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-66f58769-9c88-4a8a-aa08-3e20f82b0383 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:41.958500 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-66f58769-9c88-4a8a-aa08-3e20f82b0383 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:41.959308 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-66f58769-9c88-4a8a-aa08-3e20f82b0383 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:41.959742 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-66f58769-9c88-4a8a-aa08-3e20f82b0383 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:42.102837 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-66f58769-9c88-4a8a-aa08-3e20f82b0383 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:42.111518 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-66f58769-9c88-4a8a-aa08-3e20f82b0383 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:42.113053 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-66f58769-9c88-4a8a-aa08-3e20f82b0383 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:42.114242 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-66f58769-9c88-4a8a-aa08-3e20f82b0383 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 200 len: 1730 microversion: 2.20 time: 0.167801 Jun 30 12:43:42.114775 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 518/1029] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:43:41 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:43:43.134444 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-8bb59969-c5dc-4dd7-b178-c652ac678a40 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:43:43.135063 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-8bb59969-c5dc-4dd7-b178-c652ac678a40 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:43:43.142989 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-8bb59969-c5dc-4dd7-b178-c652ac678a40 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:43.143433 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-8bb59969-c5dc-4dd7-b178-c652ac678a40 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:43.144314 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-8bb59969-c5dc-4dd7-b178-c652ac678a40 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:43.144875 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-8bb59969-c5dc-4dd7-b178-c652ac678a40 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:43.279250 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-8bb59969-c5dc-4dd7-b178-c652ac678a40 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:43.287675 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-8bb59969-c5dc-4dd7-b178-c652ac678a40 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:43.289347 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-8bb59969-c5dc-4dd7-b178-c652ac678a40 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:43.290516 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-8bb59969-c5dc-4dd7-b178-c652ac678a40 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 200 len: 1730 microversion: 2.20 time: 0.160892 Jun 30 12:43:43.291092 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 512/1030] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:43:43 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:43:44.314743 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-ad5d918d-36ee-4703-980f-7c8658f2d648 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:43:44.315792 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-ad5d918d-36ee-4703-980f-7c8658f2d648 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:43:44.323784 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-ad5d918d-36ee-4703-980f-7c8658f2d648 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:44.324231 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-ad5d918d-36ee-4703-980f-7c8658f2d648 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:44.325052 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-ad5d918d-36ee-4703-980f-7c8658f2d648 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:44.325493 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-ad5d918d-36ee-4703-980f-7c8658f2d648 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:44.465463 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-ad5d918d-36ee-4703-980f-7c8658f2d648 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:44.477829 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-ad5d918d-36ee-4703-980f-7c8658f2d648 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:44.480094 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-ad5d918d-36ee-4703-980f-7c8658f2d648 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:44.481986 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-ad5d918d-36ee-4703-980f-7c8658f2d648 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 200 len: 1730 microversion: 2.20 time: 0.173615 Jun 30 12:43:44.482736 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 519/1031] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:43:44 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:43:45.507691 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-ff54a55c-7f78-49be-bdc8-b584e57aa2a4 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:43:45.508723 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-ff54a55c-7f78-49be-bdc8-b584e57aa2a4 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:43:45.520236 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-ff54a55c-7f78-49be-bdc8-b584e57aa2a4 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:45.521057 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-ff54a55c-7f78-49be-bdc8-b584e57aa2a4 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:45.522391 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-ff54a55c-7f78-49be-bdc8-b584e57aa2a4 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:45.523243 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-ff54a55c-7f78-49be-bdc8-b584e57aa2a4 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:45.673672 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-ff54a55c-7f78-49be-bdc8-b584e57aa2a4 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:45.686029 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-ff54a55c-7f78-49be-bdc8-b584e57aa2a4 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:45.688392 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-ff54a55c-7f78-49be-bdc8-b584e57aa2a4 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:45.690158 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-ff54a55c-7f78-49be-bdc8-b584e57aa2a4 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 200 len: 1730 microversion: 2.20 time: 0.189080 Jun 30 12:43:45.690977 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 513/1032] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:43:45 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 1730 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:43:46.712620 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-a8e15a4c-acec-4d72-b540-733505767ab2 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:43:46.713433 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-a8e15a4c-acec-4d72-b540-733505767ab2 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:43:46.722458 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-a8e15a4c-acec-4d72-b540-733505767ab2 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:46.723047 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-a8e15a4c-acec-4d72-b540-733505767ab2 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:46.724054 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-a8e15a4c-acec-4d72-b540-733505767ab2 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:46.724661 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-a8e15a4c-acec-4d72-b540-733505767ab2 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:46.748436 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG dbcounter [-] [124297] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=124297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:43:46.863963 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-a8e15a4c-acec-4d72-b540-733505767ab2 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:46.872471 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-a8e15a4c-acec-4d72-b540-733505767ab2 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:46.873998 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-a8e15a4c-acec-4d72-b540-733505767ab2 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:46.875156 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-a8e15a4c-acec-4d72-b540-733505767ab2 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 200 len: 1730 microversion: 2.20 time: 0.168844 Jun 30 12:43:46.875728 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 520/1033] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:43:46 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:43:47.894469 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-ccc99cba-fdde-4b44-9358-de3ac91fba7c tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:43:47.895074 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-ccc99cba-fdde-4b44-9358-de3ac91fba7c tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:43:47.902394 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-ccc99cba-fdde-4b44-9358-de3ac91fba7c tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:47.902832 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-ccc99cba-fdde-4b44-9358-de3ac91fba7c tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:47.903624 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-ccc99cba-fdde-4b44-9358-de3ac91fba7c tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:47.904051 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-ccc99cba-fdde-4b44-9358-de3ac91fba7c tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:48.038675 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-ccc99cba-fdde-4b44-9358-de3ac91fba7c tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:48.047493 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-ccc99cba-fdde-4b44-9358-de3ac91fba7c tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:48.049014 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-ccc99cba-fdde-4b44-9358-de3ac91fba7c tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:48.050219 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-ccc99cba-fdde-4b44-9358-de3ac91fba7c tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 200 len: 1730 microversion: 2.20 time: 0.160443 Jun 30 12:43:48.050778 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 514/1034] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:43:47 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:43:48.165805 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [req-af2d16f5-1cd5-4f19-b3b9-996cb5470513 req-c1ba8fc9-95e5-4e58-b9b3-f429ce1a41ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c79b3b73-522e-4636-bd99-234f910f3999", "name": "network-vif-plugged", "status": "completed", "tag": "89638ae7-46a1-4d58-af0e-071e8bafd6b4"}]} {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:43:48.173069 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG dbcounter [-] [124297] Writing DB stats nova_api:SELECT=32 {{(pid=124297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:43:48.175709 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [req-af2d16f5-1cd5-4f19-b3b9-996cb5470513 req-c1ba8fc9-95e5-4e58-b9b3-f429ce1a41ae service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:48.176732 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [req-af2d16f5-1cd5-4f19-b3b9-996cb5470513 req-c1ba8fc9-95e5-4e58-b9b3-f429ce1a41ae service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:48.189151 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.compute.server_external_events [req-af2d16f5-1cd5-4f19-b3b9-996cb5470513 req-c1ba8fc9-95e5-4e58-b9b3-f429ce1a41ae service nova] Creating event network-vif-plugged:89638ae7-46a1-4d58-af0e-071e8bafd6b4 for instance c79b3b73-522e-4636-bd99-234f910f3999 on hv-cinder-84614 Jun 30 12:43:48.194512 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [req-af2d16f5-1cd5-4f19-b3b9-996cb5470513 req-c1ba8fc9-95e5-4e58-b9b3-f429ce1a41ae service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032568 Jun 30 12:43:48.195165 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 521/1035] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 30 12:43:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:43:49.073181 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-3d752d7b-87de-4dae-a23b-2b34f85da5bd tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:43:49.074140 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-3d752d7b-87de-4dae-a23b-2b34f85da5bd tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:43:49.085292 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-3d752d7b-87de-4dae-a23b-2b34f85da5bd tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:49.086127 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-3d752d7b-87de-4dae-a23b-2b34f85da5bd tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:49.086905 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-3d752d7b-87de-4dae-a23b-2b34f85da5bd tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:49.087343 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-3d752d7b-87de-4dae-a23b-2b34f85da5bd tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:49.225127 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-3d752d7b-87de-4dae-a23b-2b34f85da5bd tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:49.237060 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-3d752d7b-87de-4dae-a23b-2b34f85da5bd tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:49.238591 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-3d752d7b-87de-4dae-a23b-2b34f85da5bd tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:49.239763 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-3d752d7b-87de-4dae-a23b-2b34f85da5bd tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 200 len: 1730 microversion: 2.20 time: 0.173512 Jun 30 12:43:49.240334 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 515/1036] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:43:49 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 1730 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:43:50.259325 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-6487371a-8979-4c69-a2dc-8b12804605b3 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:43:50.260058 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-6487371a-8979-4c69-a2dc-8b12804605b3 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:43:50.266630 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-6487371a-8979-4c69-a2dc-8b12804605b3 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:50.267271 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-6487371a-8979-4c69-a2dc-8b12804605b3 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:50.267925 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-6487371a-8979-4c69-a2dc-8b12804605b3 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:50.268360 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-6487371a-8979-4c69-a2dc-8b12804605b3 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:50.420648 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-6487371a-8979-4c69-a2dc-8b12804605b3 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:50.429547 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-6487371a-8979-4c69-a2dc-8b12804605b3 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:50.431161 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-6487371a-8979-4c69-a2dc-8b12804605b3 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:50.432279 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-6487371a-8979-4c69-a2dc-8b12804605b3 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 200 len: 1730 microversion: 2.20 time: 0.178270 Jun 30 12:43:50.432864 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 522/1037] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:43:50 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 1730 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:43:51.625084 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-bff658e9-b61d-46da-83b3-6582b8088102 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:43:51.625693 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-bff658e9-b61d-46da-83b3-6582b8088102 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:43:51.632000 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-bff658e9-b61d-46da-83b3-6582b8088102 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:51.632436 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-bff658e9-b61d-46da-83b3-6582b8088102 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:51.633237 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-bff658e9-b61d-46da-83b3-6582b8088102 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:51.633666 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-bff658e9-b61d-46da-83b3-6582b8088102 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:51.791846 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-bff658e9-b61d-46da-83b3-6582b8088102 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:51.804714 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-bff658e9-b61d-46da-83b3-6582b8088102 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:51.806497 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-bff658e9-b61d-46da-83b3-6582b8088102 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:43:51.808224 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-bff658e9-b61d-46da-83b3-6582b8088102 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 200 len: 1717 microversion: 2.20 time: 0.361241 Jun 30 12:43:51.809092 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 516/1038] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:43:51 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 1717 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:43:51.970312 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-1561f8c5-6d2e-4577-80e5-bc1872f2eaaa tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:43:51.970880 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-1561f8c5-6d2e-4577-80e5-bc1872f2eaaa tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: 18eee5c2-05c8-46c5-96b7-632f8130b2f7] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:43:51.978561 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-1561f8c5-6d2e-4577-80e5-bc1872f2eaaa tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:51.979055 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-1561f8c5-6d2e-4577-80e5-bc1872f2eaaa tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:51.979975 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-1561f8c5-6d2e-4577-80e5-bc1872f2eaaa tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:51.980393 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-1561f8c5-6d2e-4577-80e5-bc1872f2eaaa tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:52.005350 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-1561f8c5-6d2e-4577-80e5-bc1872f2eaaa tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "GET /compute/v2.1/servers/18eee5c2-05c8-46c5-96b7-632f8130b2f7/ips" status: 200 len: 149 microversion: 2.1 time: 0.039476 Jun 30 12:43:52.005931 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 523/1039] 10.222.0.57 () {58 vars in 1247 bytes} [Thu Jun 30 12:43:51 2022] GET /compute/v2.1/servers/18eee5c2-05c8-46c5-96b7-632f8130b2f7/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:43:53.348583 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-b7bf20f7-0de4-44f2-a98d-4890faa03530 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b902a830-0a58-4e90-bee7-504f54d72c5b"}} {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:43:53.349800 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-b7bf20f7-0de4-44f2-a98d-4890faa03530 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: 18eee5c2-05c8-46c5-96b7-632f8130b2f7] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:43:53.356883 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-b7bf20f7-0de4-44f2-a98d-4890faa03530 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:53.357270 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-b7bf20f7-0de4-44f2-a98d-4890faa03530 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:53.358021 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-b7bf20f7-0de4-44f2-a98d-4890faa03530 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:43:53.358493 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-b7bf20f7-0de4-44f2-a98d-4890faa03530 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:43:53.641144 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-b7bf20f7-0de4-44f2-a98d-4890faa03530 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "POST /compute/v2.1/servers/18eee5c2-05c8-46c5-96b7-632f8130b2f7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.296345 Jun 30 12:43:53.641754 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 517/1040] 10.222.0.57 () {60 vars in 1322 bytes} [Thu Jun 30 12:43:53 2022] POST /compute/v2.1/servers/18eee5c2-05c8-46c5-96b7-632f8130b2f7/os-volume_attachments => generated 194 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:44:01.309918 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-76ff850b-441e-4599-847e-0416da1c96f7 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:44:01.310470 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-76ff850b-441e-4599-847e-0416da1c96f7 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: 18eee5c2-05c8-46c5-96b7-632f8130b2f7] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:44:01.317624 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-76ff850b-441e-4599-847e-0416da1c96f7 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:44:01.318082 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-76ff850b-441e-4599-847e-0416da1c96f7 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:44:01.318879 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-76ff850b-441e-4599-847e-0416da1c96f7 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:44:01.319315 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-76ff850b-441e-4599-847e-0416da1c96f7 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:44:01.407028 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.objects.instance [None req-76ff850b-441e-4599-847e-0416da1c96f7 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lazy-loading 'services' on Instance uuid 18eee5c2-05c8-46c5-96b7-632f8130b2f7 {{(pid=124297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 12:44:01.490821 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-76ff850b-441e-4599-847e-0416da1c96f7 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "DELETE /compute/v2.1/servers/18eee5c2-05c8-46c5-96b7-632f8130b2f7/os-volume_attachments/b902a830-0a58-4e90-bee7-504f54d72c5b" status: 202 len: 0 microversion: 2.1 time: 0.184870 Jun 30 12:44:01.491395 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 524/1041] 10.222.0.57 () {58 vars in 1415 bytes} [Thu Jun 30 12:44:01 2022] DELETE /compute/v2.1/servers/18eee5c2-05c8-46c5-96b7-632f8130b2f7/os-volume_attachments/b902a830-0a58-4e90-bee7-504f54d72c5b => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 12:44:01.501250 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-27ab8810-568c-4685-aa0d-0b03f46c35f5 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:44:01.502439 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-27ab8810-568c-4685-aa0d-0b03f46c35f5 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: 18eee5c2-05c8-46c5-96b7-632f8130b2f7] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:44:01.508961 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-27ab8810-568c-4685-aa0d-0b03f46c35f5 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:44:01.509406 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-27ab8810-568c-4685-aa0d-0b03f46c35f5 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:44:01.510233 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-27ab8810-568c-4685-aa0d-0b03f46c35f5 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:44:01.510630 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-27ab8810-568c-4685-aa0d-0b03f46c35f5 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:44:01.541981 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-27ab8810-568c-4685-aa0d-0b03f46c35f5 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "GET /compute/v2.1/servers/18eee5c2-05c8-46c5-96b7-632f8130b2f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045768 Jun 30 12:44:01.542550 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 518/1042] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jun 30 12:44:01 2022] GET /compute/v2.1/servers/18eee5c2-05c8-46c5-96b7-632f8130b2f7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:44:02.555119 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-e99a03a6-dc8f-4a28-83f3-93eff6ad3057 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:44:02.556323 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-e99a03a6-dc8f-4a28-83f3-93eff6ad3057 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: 18eee5c2-05c8-46c5-96b7-632f8130b2f7] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:44:02.563664 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-e99a03a6-dc8f-4a28-83f3-93eff6ad3057 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:44:02.564115 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-e99a03a6-dc8f-4a28-83f3-93eff6ad3057 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:44:02.565078 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-e99a03a6-dc8f-4a28-83f3-93eff6ad3057 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:44:02.565403 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-e99a03a6-dc8f-4a28-83f3-93eff6ad3057 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:44:02.595372 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-e99a03a6-dc8f-4a28-83f3-93eff6ad3057 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "GET /compute/v2.1/servers/18eee5c2-05c8-46c5-96b7-632f8130b2f7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044931 Jun 30 12:44:02.595975 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 525/1043] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jun 30 12:44:02 2022] GET /compute/v2.1/servers/18eee5c2-05c8-46c5-96b7-632f8130b2f7/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 30 12:44:02.656195 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-0ec18b01-170b-4fea-8656-d1b49e15e651 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:44:02.656742 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-0ec18b01-170b-4fea-8656-d1b49e15e651 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: 18eee5c2-05c8-46c5-96b7-632f8130b2f7] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:44:02.663428 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-0ec18b01-170b-4fea-8656-d1b49e15e651 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:44:02.663875 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-0ec18b01-170b-4fea-8656-d1b49e15e651 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:44:02.664660 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-0ec18b01-170b-4fea-8656-d1b49e15e651 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:44:02.665097 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-0ec18b01-170b-4fea-8656-d1b49e15e651 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:44:02.667736 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG dbcounter [-] [124298] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:44:02.692080 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-0ec18b01-170b-4fea-8656-d1b49e15e651 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: 18eee5c2-05c8-46c5-96b7-632f8130b2f7] Going to try to terminate instance {{(pid=124298) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 12:44:02.768935 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-0ec18b01-170b-4fea-8656-d1b49e15e651 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "DELETE /compute/v2.1/servers/18eee5c2-05c8-46c5-96b7-632f8130b2f7" status: 204 len: 0 microversion: 2.1 time: 0.116060 Jun 30 12:44:02.769489 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 519/1044] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 30 12:44:02 2022] DELETE /compute/v2.1/servers/18eee5c2-05c8-46c5-96b7-632f8130b2f7 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 12:44:02.778415 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-e9916bfd-4eca-40dd-99c4-8e2bc81cfec5 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:44:02.779037 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-e9916bfd-4eca-40dd-99c4-8e2bc81cfec5 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: 18eee5c2-05c8-46c5-96b7-632f8130b2f7] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:44:02.785449 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-e9916bfd-4eca-40dd-99c4-8e2bc81cfec5 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:44:02.785896 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-e9916bfd-4eca-40dd-99c4-8e2bc81cfec5 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:44:02.786763 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-e9916bfd-4eca-40dd-99c4-8e2bc81cfec5 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:44:02.787199 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-e9916bfd-4eca-40dd-99c4-8e2bc81cfec5 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:44:02.930615 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-e9916bfd-4eca-40dd-99c4-8e2bc81cfec5 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e935f2637d124453947b3c78360567a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359201313a944a8fa9881ee6fdea67e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:44:02.938730 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-e9916bfd-4eca-40dd-99c4-8e2bc81cfec5 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "GET /compute/v2.1/servers/18eee5c2-05c8-46c5-96b7-632f8130b2f7" status: 200 len: 1680 microversion: 2.1 time: 0.164275 Jun 30 12:44:02.939309 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 526/1045] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:44:02 2022] GET /compute/v2.1/servers/18eee5c2-05c8-46c5-96b7-632f8130b2f7 => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:44:03.956070 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-139681f7-56c0-47fc-a8aa-9fe0d28a79d1 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:44:03.956911 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-139681f7-56c0-47fc-a8aa-9fe0d28a79d1 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: 18eee5c2-05c8-46c5-96b7-632f8130b2f7] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:44:03.963754 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-139681f7-56c0-47fc-a8aa-9fe0d28a79d1 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:44:03.964230 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-139681f7-56c0-47fc-a8aa-9fe0d28a79d1 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:44:03.965032 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-139681f7-56c0-47fc-a8aa-9fe0d28a79d1 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:44:03.965471 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-139681f7-56c0-47fc-a8aa-9fe0d28a79d1 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:44:04.097211 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-139681f7-56c0-47fc-a8aa-9fe0d28a79d1 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e935f2637d124453947b3c78360567a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359201313a944a8fa9881ee6fdea67e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:44:04.105236 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-139681f7-56c0-47fc-a8aa-9fe0d28a79d1 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "GET /compute/v2.1/servers/18eee5c2-05c8-46c5-96b7-632f8130b2f7" status: 200 len: 1680 microversion: 2.1 time: 0.153527 Jun 30 12:44:04.105812 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 520/1046] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:44:03 2022] GET /compute/v2.1/servers/18eee5c2-05c8-46c5-96b7-632f8130b2f7 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:44:05.123726 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-c5a58475-eb8f-4b6b-ba53-4b478eff3344 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:44:05.124340 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-c5a58475-eb8f-4b6b-ba53-4b478eff3344 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: 18eee5c2-05c8-46c5-96b7-632f8130b2f7] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:44:05.131175 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-c5a58475-eb8f-4b6b-ba53-4b478eff3344 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:44:05.131624 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-c5a58475-eb8f-4b6b-ba53-4b478eff3344 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:44:05.132402 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-c5a58475-eb8f-4b6b-ba53-4b478eff3344 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:44:05.132874 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-c5a58475-eb8f-4b6b-ba53-4b478eff3344 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:44:05.201572 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-c5a58475-eb8f-4b6b-ba53-4b478eff3344 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e935f2637d124453947b3c78360567a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359201313a944a8fa9881ee6fdea67e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:44:05.210026 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-c5a58475-eb8f-4b6b-ba53-4b478eff3344 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "GET /compute/v2.1/servers/18eee5c2-05c8-46c5-96b7-632f8130b2f7" status: 200 len: 1613 microversion: 2.1 time: 0.090103 Jun 30 12:44:05.210645 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 527/1047] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:44:05 2022] GET /compute/v2.1/servers/18eee5c2-05c8-46c5-96b7-632f8130b2f7 => generated 1613 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:44:05.464281 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [req-d31db445-8783-4322-8e8a-492bdba45853 req-039fc061-ae98-4305-af2d-cac6f0787908 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18eee5c2-05c8-46c5-96b7-632f8130b2f7", "name": "network-vif-deleted", "tag": "2f7f61d7-a608-4f6b-839c-937a066bca6e"}]} {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:44:05.479119 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [req-d31db445-8783-4322-8e8a-492bdba45853 req-039fc061-ae98-4305-af2d-cac6f0787908 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:44:05.479833 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [req-d31db445-8783-4322-8e8a-492bdba45853 req-039fc061-ae98-4305-af2d-cac6f0787908 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:44:05.494559 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.compute.server_external_events [req-d31db445-8783-4322-8e8a-492bdba45853 req-039fc061-ae98-4305-af2d-cac6f0787908 service nova] Creating event network-vif-deleted:2f7f61d7-a608-4f6b-839c-937a066bca6e for instance 18eee5c2-05c8-46c5-96b7-632f8130b2f7 on hv-cinder-84614 Jun 30 12:44:05.499982 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [req-d31db445-8783-4322-8e8a-492bdba45853 req-039fc061-ae98-4305-af2d-cac6f0787908 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104528 Jun 30 12:44:05.500571 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 521/1048] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 30 12:44:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:44:06.229033 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-b703866d-1c0b-4aa5-9068-68d50b086f6b tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:44:06.229653 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-b703866d-1c0b-4aa5-9068-68d50b086f6b tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: 18eee5c2-05c8-46c5-96b7-632f8130b2f7] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:44:06.236589 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-b703866d-1c0b-4aa5-9068-68d50b086f6b tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:44:06.237087 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-b703866d-1c0b-4aa5-9068-68d50b086f6b tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:44:06.237861 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-b703866d-1c0b-4aa5-9068-68d50b086f6b tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:44:06.238422 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-b703866d-1c0b-4aa5-9068-68d50b086f6b tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:44:06.252344 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.wsgi [None req-b703866d-1c0b-4aa5-9068-68d50b086f6b tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] HTTP exception thrown: Instance 18eee5c2-05c8-46c5-96b7-632f8130b2f7 could not be found. Jun 30 12:44:06.254135 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-b703866d-1c0b-4aa5-9068-68d50b086f6b tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Request method failure captured: Jun 30 12:44:06.254135 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: request: GET /compute/v2.1/servers/18eee5c2-05c8-46c5-96b7-632f8130b2f7 HTTP/1.1 Jun 30 12:44:06.254135 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Accept: application/json Jun 30 12:44:06.254135 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Accept-Encoding: identity Jun 30 12:44:06.254135 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Connection: close Jun 30 12:44:06.254135 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Content-Length: 0 Jun 30 12:44:06.254135 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Content-Type: application/json Jun 30 12:44:06.254135 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Host: 10.222.0.57 Jun 30 12:44:06.254135 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Openstack-System-Scope: None Jun 30 12:44:06.254135 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: User-Agent: python-urllib3/1.26.9 Jun 30 12:44:06.254135 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Auth-Token: gAAAAABivZmUr5nE4sldlZsaj95gPYoaAcBmGRBy3I0hmzGn3iQqv5ZAgj-BPoF3DR2aprIIyzc4pOztEbmcfd7zRGCrhNVOgSUbHkrARCCB7THaqy8PU7wn9dODyPqFpdlPJv1XzD49N3q7ykzG0OSF7WObsxYnk2T0E2GFDSZRVSwfbpGoHiI Jun 30 12:44:06.254135 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Domain-Id: None Jun 30 12:44:06.254135 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Domain-Name: None Jun 30 12:44:06.254135 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Identity-Status: Confirmed Jun 30 12:44:06.254135 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Is-Admin-Project: True Jun 30 12:44:06.254135 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Project-Domain-Id: default Jun 30 12:44:06.254135 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Project-Domain-Name: Default Jun 30 12:44:06.254135 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Project-Id: 359201313a944a8fa9881ee6fdea67e2 Jun 30 12:44:06.254135 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Project-Name: tempest-AttachVolumeNegativeTest-110304785 Jun 30 12:44:06.254135 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Role: member,reader Jun 30 12:44:06.254135 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Roles: member,reader Jun 30 12:44:06.255726 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/359201313a944a8fa9881ee6fdea67e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/359201313a944a8fa9881ee6fdea67e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_359201313a944a8fa9881ee6fdea67e2", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/359201313a944a8fa9881ee6fdea67e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 30 12:44:06.255726 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Tenant: tempest-AttachVolumeNegativeTest-110304785 Jun 30 12:44:06.255726 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Tenant-Id: 359201313a944a8fa9881ee6fdea67e2 Jun 30 12:44:06.255726 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-110304785 Jun 30 12:44:06.255726 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User: tempest-AttachVolumeNegativeTest-110304785-project Jun 30 12:44:06.255726 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User-Domain-Id: default Jun 30 12:44:06.255726 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User-Domain-Name: Default Jun 30 12:44:06.255726 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User-Id: e935f2637d124453947b3c78360567a5 Jun 30 12:44:06.255726 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User-Name: tempest-AttachVolumeNegativeTest-110304785-project Jun 30 12:44:06.255726 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: method: > Jun 30 12:44:06.255726 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: exception: Instance 18eee5c2-05c8-46c5-96b7-632f8130b2f7 could not be found. Jun 30 12:44:06.255726 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: action_args: {'id': '18eee5c2-05c8-46c5-96b7-632f8130b2f7'} Jun 30 12:44:06.256515 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 12:44:06.256515 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:44:06.256515 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 12:44:06.256515 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 12:44:06.256515 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 12:44:06.256515 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 12:44:06.256515 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 12:44:06.256515 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 12:44:06.256515 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 12:44:06.256515 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 12:44:06.256515 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18eee5c2-05c8-46c5-96b7-632f8130b2f7 could not be found. Jun 30 12:44:06.256515 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:44:06.256515 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:44:06.256515 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:44:06.256515 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:44:06.256515 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:44:06.256515 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:44:06.256515 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 12:44:06.256515 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 12:44:06.256515 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 12:44:06.257869 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 12:44:06.257869 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 12:44:06.257869 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 12:44:06.257869 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 12:44:06.257869 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 12:44:06.257869 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 12:44:06.257869 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 12:44:06.257869 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18eee5c2-05c8-46c5-96b7-632f8130b2f7 could not be found. Jun 30 12:44:06.257869 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:44:06.257869 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:44:06.257869 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:44:06.257869 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:44:06.257869 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:44:06.257869 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:44:06.257869 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 12:44:06.257869 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 12:44:06.257869 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18eee5c2-05c8-46c5-96b7-632f8130b2f7 could not be found. Jun 30 12:44:06.257869 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:44:06.260187 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-b703866d-1c0b-4aa5-9068-68d50b086f6b tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Returning 404 to user: Instance 18eee5c2-05c8-46c5-96b7-632f8130b2f7 could not be found. {{(pid=124297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 12:44:06.260187 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-b703866d-1c0b-4aa5-9068-68d50b086f6b tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "GET /compute/v2.1/servers/18eee5c2-05c8-46c5-96b7-632f8130b2f7" status: 404 len: 111 microversion: 2.1 time: 0.030733 Jun 30 12:44:06.260187 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 528/1049] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:44:06 2022] GET /compute/v2.1/servers/18eee5c2-05c8-46c5-96b7-632f8130b2f7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 12:44:06.265458 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-05af3563-79a7-4b06-a05c-33970d55fb41 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Calling method '.version_select at 0x7fd0e02cd280>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:44:06.286565 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-05af3563-79a7-4b06-a05c-33970d55fb41 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1884757416" status: 202 len: 0 microversion: 2.1 time: 0.025095 Jun 30 12:44:06.287264 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 522/1050] 10.222.0.57 () {58 vars in 1220 bytes} [Thu Jun 30 12:44:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1884757416 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 12:44:08.058696 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-9c2d182e-dd1b-4e9b-8638-fa35f0b598b1 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:44:08.059221 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-9c2d182e-dd1b-4e9b-8638-fa35f0b598b1 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: 18eee5c2-05c8-46c5-96b7-632f8130b2f7] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:44:08.066185 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-9c2d182e-dd1b-4e9b-8638-fa35f0b598b1 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:44:08.066922 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-9c2d182e-dd1b-4e9b-8638-fa35f0b598b1 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:44:08.067803 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-9c2d182e-dd1b-4e9b-8638-fa35f0b598b1 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:44:08.068231 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-9c2d182e-dd1b-4e9b-8638-fa35f0b598b1 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:44:08.083212 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.wsgi [None req-9c2d182e-dd1b-4e9b-8638-fa35f0b598b1 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] HTTP exception thrown: Instance 18eee5c2-05c8-46c5-96b7-632f8130b2f7 could not be found. Jun 30 12:44:08.084796 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-9c2d182e-dd1b-4e9b-8638-fa35f0b598b1 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Request method failure captured: Jun 30 12:44:08.084796 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: request: DELETE /compute/v2.1/servers/18eee5c2-05c8-46c5-96b7-632f8130b2f7 HTTP/1.1 Jun 30 12:44:08.084796 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Accept: application/json Jun 30 12:44:08.084796 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Accept-Encoding: identity Jun 30 12:44:08.084796 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Connection: close Jun 30 12:44:08.084796 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Content-Length: 0 Jun 30 12:44:08.084796 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Content-Type: application/json Jun 30 12:44:08.084796 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Host: 10.222.0.57 Jun 30 12:44:08.084796 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Openstack-System-Scope: None Jun 30 12:44:08.084796 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: User-Agent: python-urllib3/1.26.9 Jun 30 12:44:08.084796 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Auth-Token: gAAAAABivZmUr5nE4sldlZsaj95gPYoaAcBmGRBy3I0hmzGn3iQqv5ZAgj-BPoF3DR2aprIIyzc4pOztEbmcfd7zRGCrhNVOgSUbHkrARCCB7THaqy8PU7wn9dODyPqFpdlPJv1XzD49N3q7ykzG0OSF7WObsxYnk2T0E2GFDSZRVSwfbpGoHiI Jun 30 12:44:08.084796 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Domain-Id: None Jun 30 12:44:08.084796 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Domain-Name: None Jun 30 12:44:08.084796 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Identity-Status: Confirmed Jun 30 12:44:08.084796 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Is-Admin-Project: True Jun 30 12:44:08.084796 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Project-Domain-Id: default Jun 30 12:44:08.084796 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Project-Domain-Name: Default Jun 30 12:44:08.084796 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Project-Id: 359201313a944a8fa9881ee6fdea67e2 Jun 30 12:44:08.084796 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Project-Name: tempest-AttachVolumeNegativeTest-110304785 Jun 30 12:44:08.084796 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Role: member,reader Jun 30 12:44:08.084796 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Roles: member,reader Jun 30 12:44:08.086400 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/359201313a944a8fa9881ee6fdea67e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/359201313a944a8fa9881ee6fdea67e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_359201313a944a8fa9881ee6fdea67e2", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/359201313a944a8fa9881ee6fdea67e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 30 12:44:08.086400 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Tenant: tempest-AttachVolumeNegativeTest-110304785 Jun 30 12:44:08.086400 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Tenant-Id: 359201313a944a8fa9881ee6fdea67e2 Jun 30 12:44:08.086400 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-110304785 Jun 30 12:44:08.086400 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User: tempest-AttachVolumeNegativeTest-110304785-project Jun 30 12:44:08.086400 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User-Domain-Id: default Jun 30 12:44:08.086400 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User-Domain-Name: Default Jun 30 12:44:08.086400 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User-Id: e935f2637d124453947b3c78360567a5 Jun 30 12:44:08.086400 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User-Name: tempest-AttachVolumeNegativeTest-110304785-project Jun 30 12:44:08.086400 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: method: > Jun 30 12:44:08.086400 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: exception: Instance 18eee5c2-05c8-46c5-96b7-632f8130b2f7 could not be found. Jun 30 12:44:08.086400 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: action_args: {'id': '18eee5c2-05c8-46c5-96b7-632f8130b2f7'} Jun 30 12:44:08.087297 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 12:44:08.087297 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:44:08.087297 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 12:44:08.087297 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 12:44:08.087297 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 12:44:08.087297 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 12:44:08.087297 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 12:44:08.087297 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 12:44:08.087297 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 12:44:08.087297 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 12:44:08.087297 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18eee5c2-05c8-46c5-96b7-632f8130b2f7 could not be found. Jun 30 12:44:08.087297 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:44:08.087297 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:44:08.087297 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:44:08.087297 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:44:08.087297 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:44:08.087297 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:44:08.087297 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 12:44:08.087297 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 12:44:08.087297 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 12:44:08.088577 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 12:44:08.088577 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 30 12:44:08.088577 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 30 12:44:08.088577 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 30 12:44:08.088577 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 30 12:44:08.088577 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 12:44:08.088577 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 12:44:08.088577 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 12:44:08.088577 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 12:44:08.088577 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18eee5c2-05c8-46c5-96b7-632f8130b2f7 could not be found. Jun 30 12:44:08.088577 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:44:08.088577 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:44:08.088577 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:44:08.088577 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:44:08.088577 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:44:08.088577 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:44:08.088577 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 12:44:08.088577 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 12:44:08.088577 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18eee5c2-05c8-46c5-96b7-632f8130b2f7 could not be found. Jun 30 12:44:08.088577 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:44:08.089890 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-9c2d182e-dd1b-4e9b-8638-fa35f0b598b1 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Returning 404 to user: Instance 18eee5c2-05c8-46c5-96b7-632f8130b2f7 could not be found. {{(pid=124297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 12:44:08.089890 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-9c2d182e-dd1b-4e9b-8638-fa35f0b598b1 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "DELETE /compute/v2.1/servers/18eee5c2-05c8-46c5-96b7-632f8130b2f7" status: 404 len: 111 microversion: 2.1 time: 0.031372 Jun 30 12:44:08.089890 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 529/1051] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 30 12:44:08 2022] DELETE /compute/v2.1/servers/18eee5c2-05c8-46c5-96b7-632f8130b2f7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 12:44:08.095409 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-5ba14bb8-daa2-48bc-96a4-ca739e85c28b tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:44:08.096150 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-5ba14bb8-daa2-48bc-96a4-ca739e85c28b tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: 18eee5c2-05c8-46c5-96b7-632f8130b2f7] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:44:08.103124 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-5ba14bb8-daa2-48bc-96a4-ca739e85c28b tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:44:08.103607 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-5ba14bb8-daa2-48bc-96a4-ca739e85c28b tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:44:08.104479 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-5ba14bb8-daa2-48bc-96a4-ca739e85c28b tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:44:08.104978 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-5ba14bb8-daa2-48bc-96a4-ca739e85c28b tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:44:08.118986 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.wsgi [None req-5ba14bb8-daa2-48bc-96a4-ca739e85c28b tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] HTTP exception thrown: Instance 18eee5c2-05c8-46c5-96b7-632f8130b2f7 could not be found. Jun 30 12:44:08.120659 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-5ba14bb8-daa2-48bc-96a4-ca739e85c28b tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Request method failure captured: Jun 30 12:44:08.120659 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: request: GET /compute/v2.1/servers/18eee5c2-05c8-46c5-96b7-632f8130b2f7 HTTP/1.1 Jun 30 12:44:08.120659 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Accept: application/json Jun 30 12:44:08.120659 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Accept-Encoding: identity Jun 30 12:44:08.120659 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Connection: close Jun 30 12:44:08.120659 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Content-Length: 0 Jun 30 12:44:08.120659 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Content-Type: application/json Jun 30 12:44:08.120659 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Host: 10.222.0.57 Jun 30 12:44:08.120659 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Openstack-System-Scope: None Jun 30 12:44:08.120659 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: User-Agent: python-urllib3/1.26.9 Jun 30 12:44:08.120659 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Auth-Token: gAAAAABivZmUr5nE4sldlZsaj95gPYoaAcBmGRBy3I0hmzGn3iQqv5ZAgj-BPoF3DR2aprIIyzc4pOztEbmcfd7zRGCrhNVOgSUbHkrARCCB7THaqy8PU7wn9dODyPqFpdlPJv1XzD49N3q7ykzG0OSF7WObsxYnk2T0E2GFDSZRVSwfbpGoHiI Jun 30 12:44:08.120659 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Domain-Id: None Jun 30 12:44:08.120659 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Domain-Name: None Jun 30 12:44:08.120659 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Identity-Status: Confirmed Jun 30 12:44:08.120659 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Is-Admin-Project: True Jun 30 12:44:08.120659 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Domain-Id: default Jun 30 12:44:08.120659 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Domain-Name: Default Jun 30 12:44:08.120659 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Id: 359201313a944a8fa9881ee6fdea67e2 Jun 30 12:44:08.120659 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Name: tempest-AttachVolumeNegativeTest-110304785 Jun 30 12:44:08.120659 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Role: member,reader Jun 30 12:44:08.120659 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Roles: member,reader Jun 30 12:44:08.122224 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/359201313a944a8fa9881ee6fdea67e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/359201313a944a8fa9881ee6fdea67e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_359201313a944a8fa9881ee6fdea67e2", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/359201313a944a8fa9881ee6fdea67e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 30 12:44:08.122224 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant: tempest-AttachVolumeNegativeTest-110304785 Jun 30 12:44:08.122224 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant-Id: 359201313a944a8fa9881ee6fdea67e2 Jun 30 12:44:08.122224 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-110304785 Jun 30 12:44:08.122224 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User: tempest-AttachVolumeNegativeTest-110304785-project Jun 30 12:44:08.122224 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Domain-Id: default Jun 30 12:44:08.122224 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Domain-Name: Default Jun 30 12:44:08.122224 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Id: e935f2637d124453947b3c78360567a5 Jun 30 12:44:08.122224 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Name: tempest-AttachVolumeNegativeTest-110304785-project Jun 30 12:44:08.122224 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: method: > Jun 30 12:44:08.122224 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: exception: Instance 18eee5c2-05c8-46c5-96b7-632f8130b2f7 could not be found. Jun 30 12:44:08.122224 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: action_args: {'id': '18eee5c2-05c8-46c5-96b7-632f8130b2f7'} Jun 30 12:44:08.123058 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 12:44:08.123058 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:44:08.123058 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 12:44:08.123058 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 12:44:08.123058 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 12:44:08.123058 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 12:44:08.123058 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 12:44:08.123058 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 12:44:08.123058 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 12:44:08.123058 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 12:44:08.123058 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18eee5c2-05c8-46c5-96b7-632f8130b2f7 could not be found. Jun 30 12:44:08.123058 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:44:08.123058 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:44:08.123058 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:44:08.123058 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:44:08.123058 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:44:08.123058 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:44:08.123058 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 12:44:08.123058 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 12:44:08.123058 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 12:44:08.124327 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 12:44:08.124327 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 12:44:08.124327 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 12:44:08.124327 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 12:44:08.124327 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 12:44:08.124327 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 12:44:08.124327 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 12:44:08.124327 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18eee5c2-05c8-46c5-96b7-632f8130b2f7 could not be found. Jun 30 12:44:08.124327 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:44:08.124327 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:44:08.124327 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:44:08.124327 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:44:08.124327 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:44:08.124327 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:44:08.124327 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 12:44:08.124327 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 12:44:08.124327 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18eee5c2-05c8-46c5-96b7-632f8130b2f7 could not be found. Jun 30 12:44:08.124327 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:44:08.125724 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-5ba14bb8-daa2-48bc-96a4-ca739e85c28b tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Returning 404 to user: Instance 18eee5c2-05c8-46c5-96b7-632f8130b2f7 could not be found. {{(pid=124298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 12:44:08.125724 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-5ba14bb8-daa2-48bc-96a4-ca739e85c28b tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "GET /compute/v2.1/servers/18eee5c2-05c8-46c5-96b7-632f8130b2f7" status: 404 len: 111 microversion: 2.1 time: 0.031070 Jun 30 12:44:08.125724 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 523/1052] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:44:08 2022] GET /compute/v2.1/servers/18eee5c2-05c8-46c5-96b7-632f8130b2f7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 12:44:09.280959 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-012389de-872a-4440-b833-d5a675a3404f tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:44:09.281486 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-012389de-872a-4440-b833-d5a675a3404f tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: 265d3404-34ac-4563-b1a8-f525c5b63888] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:44:09.288146 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-012389de-872a-4440-b833-d5a675a3404f tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:44:09.288594 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-012389de-872a-4440-b833-d5a675a3404f tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:44:09.289379 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-012389de-872a-4440-b833-d5a675a3404f tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:44:09.289817 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-012389de-872a-4440-b833-d5a675a3404f tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:44:09.303507 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.wsgi [None req-012389de-872a-4440-b833-d5a675a3404f tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] HTTP exception thrown: Instance 265d3404-34ac-4563-b1a8-f525c5b63888 could not be found. Jun 30 12:44:09.305120 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-012389de-872a-4440-b833-d5a675a3404f tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Request method failure captured: Jun 30 12:44:09.305120 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: request: DELETE /compute/v2.1/servers/265d3404-34ac-4563-b1a8-f525c5b63888 HTTP/1.1 Jun 30 12:44:09.305120 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Accept: application/json Jun 30 12:44:09.305120 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Accept-Encoding: identity Jun 30 12:44:09.305120 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Connection: close Jun 30 12:44:09.305120 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Content-Length: 0 Jun 30 12:44:09.305120 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Content-Type: application/json Jun 30 12:44:09.305120 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Host: 10.222.0.57 Jun 30 12:44:09.305120 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Openstack-System-Scope: None Jun 30 12:44:09.305120 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: User-Agent: python-urllib3/1.26.9 Jun 30 12:44:09.305120 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Auth-Token: gAAAAABivZmUr5nE4sldlZsaj95gPYoaAcBmGRBy3I0hmzGn3iQqv5ZAgj-BPoF3DR2aprIIyzc4pOztEbmcfd7zRGCrhNVOgSUbHkrARCCB7THaqy8PU7wn9dODyPqFpdlPJv1XzD49N3q7ykzG0OSF7WObsxYnk2T0E2GFDSZRVSwfbpGoHiI Jun 30 12:44:09.305120 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Domain-Id: None Jun 30 12:44:09.305120 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Domain-Name: None Jun 30 12:44:09.305120 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Identity-Status: Confirmed Jun 30 12:44:09.305120 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Is-Admin-Project: True Jun 30 12:44:09.305120 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Project-Domain-Id: default Jun 30 12:44:09.305120 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Project-Domain-Name: Default Jun 30 12:44:09.305120 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Project-Id: 359201313a944a8fa9881ee6fdea67e2 Jun 30 12:44:09.305120 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Project-Name: tempest-AttachVolumeNegativeTest-110304785 Jun 30 12:44:09.305120 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Role: member,reader Jun 30 12:44:09.305120 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Roles: member,reader Jun 30 12:44:09.306656 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/359201313a944a8fa9881ee6fdea67e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/359201313a944a8fa9881ee6fdea67e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_359201313a944a8fa9881ee6fdea67e2", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/359201313a944a8fa9881ee6fdea67e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 30 12:44:09.306656 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Tenant: tempest-AttachVolumeNegativeTest-110304785 Jun 30 12:44:09.306656 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Tenant-Id: 359201313a944a8fa9881ee6fdea67e2 Jun 30 12:44:09.306656 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-110304785 Jun 30 12:44:09.306656 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User: tempest-AttachVolumeNegativeTest-110304785-project Jun 30 12:44:09.306656 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User-Domain-Id: default Jun 30 12:44:09.306656 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User-Domain-Name: Default Jun 30 12:44:09.306656 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User-Id: e935f2637d124453947b3c78360567a5 Jun 30 12:44:09.306656 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User-Name: tempest-AttachVolumeNegativeTest-110304785-project Jun 30 12:44:09.306656 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: method: > Jun 30 12:44:09.306656 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: exception: Instance 265d3404-34ac-4563-b1a8-f525c5b63888 could not be found. Jun 30 12:44:09.306656 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: action_args: {'id': '265d3404-34ac-4563-b1a8-f525c5b63888'} Jun 30 12:44:09.307665 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 12:44:09.307665 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:44:09.307665 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 12:44:09.307665 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 12:44:09.307665 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 12:44:09.307665 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 12:44:09.307665 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 12:44:09.307665 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 12:44:09.307665 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 12:44:09.307665 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 12:44:09.307665 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 265d3404-34ac-4563-b1a8-f525c5b63888 could not be found. Jun 30 12:44:09.307665 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:44:09.307665 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:44:09.307665 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:44:09.307665 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:44:09.307665 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:44:09.307665 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:44:09.307665 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 12:44:09.307665 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 12:44:09.307665 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 12:44:09.309193 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 12:44:09.309193 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 30 12:44:09.309193 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 30 12:44:09.309193 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 30 12:44:09.309193 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 30 12:44:09.309193 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 12:44:09.309193 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 12:44:09.309193 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 12:44:09.309193 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 12:44:09.309193 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 265d3404-34ac-4563-b1a8-f525c5b63888 could not be found. Jun 30 12:44:09.309193 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:44:09.309193 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:44:09.309193 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:44:09.309193 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:44:09.309193 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:44:09.309193 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:44:09.309193 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 12:44:09.309193 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 12:44:09.309193 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 265d3404-34ac-4563-b1a8-f525c5b63888 could not be found. Jun 30 12:44:09.309193 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:44:09.310791 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-012389de-872a-4440-b833-d5a675a3404f tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Returning 404 to user: Instance 265d3404-34ac-4563-b1a8-f525c5b63888 could not be found. {{(pid=124297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 12:44:09.310791 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-012389de-872a-4440-b833-d5a675a3404f tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "DELETE /compute/v2.1/servers/265d3404-34ac-4563-b1a8-f525c5b63888" status: 404 len: 111 microversion: 2.1 time: 0.029494 Jun 30 12:44:09.310791 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 530/1053] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 30 12:44:09 2022] DELETE /compute/v2.1/servers/265d3404-34ac-4563-b1a8-f525c5b63888 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 12:44:09.315144 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-9ee5e34e-ddb5-4aaf-8084-78ea729e53f8 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:44:09.315764 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-9ee5e34e-ddb5-4aaf-8084-78ea729e53f8 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: 265d3404-34ac-4563-b1a8-f525c5b63888] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:44:09.322552 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-9ee5e34e-ddb5-4aaf-8084-78ea729e53f8 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:44:09.323002 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-9ee5e34e-ddb5-4aaf-8084-78ea729e53f8 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:44:09.323773 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-9ee5e34e-ddb5-4aaf-8084-78ea729e53f8 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:44:09.324207 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-9ee5e34e-ddb5-4aaf-8084-78ea729e53f8 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:44:09.338449 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.wsgi [None req-9ee5e34e-ddb5-4aaf-8084-78ea729e53f8 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] HTTP exception thrown: Instance 265d3404-34ac-4563-b1a8-f525c5b63888 could not be found. Jun 30 12:44:09.339988 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-9ee5e34e-ddb5-4aaf-8084-78ea729e53f8 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Request method failure captured: Jun 30 12:44:09.339988 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: request: GET /compute/v2.1/servers/265d3404-34ac-4563-b1a8-f525c5b63888 HTTP/1.1 Jun 30 12:44:09.339988 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Accept: application/json Jun 30 12:44:09.339988 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Accept-Encoding: identity Jun 30 12:44:09.339988 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Connection: close Jun 30 12:44:09.339988 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Content-Length: 0 Jun 30 12:44:09.339988 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Content-Type: application/json Jun 30 12:44:09.339988 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Host: 10.222.0.57 Jun 30 12:44:09.339988 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Openstack-System-Scope: None Jun 30 12:44:09.339988 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: User-Agent: python-urllib3/1.26.9 Jun 30 12:44:09.339988 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Auth-Token: gAAAAABivZmUr5nE4sldlZsaj95gPYoaAcBmGRBy3I0hmzGn3iQqv5ZAgj-BPoF3DR2aprIIyzc4pOztEbmcfd7zRGCrhNVOgSUbHkrARCCB7THaqy8PU7wn9dODyPqFpdlPJv1XzD49N3q7ykzG0OSF7WObsxYnk2T0E2GFDSZRVSwfbpGoHiI Jun 30 12:44:09.339988 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Domain-Id: None Jun 30 12:44:09.339988 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Domain-Name: None Jun 30 12:44:09.339988 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Identity-Status: Confirmed Jun 30 12:44:09.339988 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Is-Admin-Project: True Jun 30 12:44:09.339988 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Domain-Id: default Jun 30 12:44:09.339988 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Domain-Name: Default Jun 30 12:44:09.339988 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Id: 359201313a944a8fa9881ee6fdea67e2 Jun 30 12:44:09.339988 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Name: tempest-AttachVolumeNegativeTest-110304785 Jun 30 12:44:09.339988 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Role: member,reader Jun 30 12:44:09.339988 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Roles: member,reader Jun 30 12:44:09.341690 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/359201313a944a8fa9881ee6fdea67e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/359201313a944a8fa9881ee6fdea67e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_359201313a944a8fa9881ee6fdea67e2", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/359201313a944a8fa9881ee6fdea67e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 30 12:44:09.341690 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant: tempest-AttachVolumeNegativeTest-110304785 Jun 30 12:44:09.341690 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant-Id: 359201313a944a8fa9881ee6fdea67e2 Jun 30 12:44:09.341690 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-110304785 Jun 30 12:44:09.341690 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User: tempest-AttachVolumeNegativeTest-110304785-project Jun 30 12:44:09.341690 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Domain-Id: default Jun 30 12:44:09.341690 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Domain-Name: Default Jun 30 12:44:09.341690 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Id: e935f2637d124453947b3c78360567a5 Jun 30 12:44:09.341690 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Name: tempest-AttachVolumeNegativeTest-110304785-project Jun 30 12:44:09.341690 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: method: > Jun 30 12:44:09.341690 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: exception: Instance 265d3404-34ac-4563-b1a8-f525c5b63888 could not be found. Jun 30 12:44:09.341690 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: action_args: {'id': '265d3404-34ac-4563-b1a8-f525c5b63888'} Jun 30 12:44:09.342503 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 12:44:09.342503 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:44:09.342503 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 12:44:09.342503 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 12:44:09.342503 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 12:44:09.342503 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 12:44:09.342503 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 12:44:09.342503 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 12:44:09.342503 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 12:44:09.342503 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 12:44:09.342503 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 265d3404-34ac-4563-b1a8-f525c5b63888 could not be found. Jun 30 12:44:09.342503 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:44:09.342503 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:44:09.342503 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:44:09.342503 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:44:09.342503 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:44:09.342503 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:44:09.342503 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 12:44:09.342503 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 12:44:09.342503 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 12:44:09.343761 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 12:44:09.343761 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 12:44:09.343761 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 12:44:09.343761 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 12:44:09.343761 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 12:44:09.343761 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 12:44:09.343761 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 12:44:09.343761 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 265d3404-34ac-4563-b1a8-f525c5b63888 could not be found. Jun 30 12:44:09.343761 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:44:09.343761 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:44:09.343761 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:44:09.343761 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:44:09.343761 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:44:09.343761 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:44:09.343761 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 12:44:09.343761 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 12:44:09.343761 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 265d3404-34ac-4563-b1a8-f525c5b63888 could not be found. Jun 30 12:44:09.343761 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:44:09.344936 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-9ee5e34e-ddb5-4aaf-8084-78ea729e53f8 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Returning 404 to user: Instance 265d3404-34ac-4563-b1a8-f525c5b63888 could not be found. {{(pid=124298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 12:44:09.344936 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-9ee5e34e-ddb5-4aaf-8084-78ea729e53f8 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "GET /compute/v2.1/servers/265d3404-34ac-4563-b1a8-f525c5b63888" status: 404 len: 111 microversion: 2.1 time: 0.030235 Jun 30 12:44:09.344936 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 524/1054] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:44:09 2022] GET /compute/v2.1/servers/265d3404-34ac-4563-b1a8-f525c5b63888 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 12:44:09.350370 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-130a9850-cee2-492f-8908-f0843754182d tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:44:09.350872 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-130a9850-cee2-492f-8908-f0843754182d tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: ba748986-dc18-4e3c-98fd-f3f0a6a46e2e] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:44:09.358519 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-130a9850-cee2-492f-8908-f0843754182d tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:44:09.358976 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-130a9850-cee2-492f-8908-f0843754182d tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:44:09.359753 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-130a9850-cee2-492f-8908-f0843754182d tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:44:09.360193 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-130a9850-cee2-492f-8908-f0843754182d tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:44:09.374216 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.wsgi [None req-130a9850-cee2-492f-8908-f0843754182d tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] HTTP exception thrown: Instance ba748986-dc18-4e3c-98fd-f3f0a6a46e2e could not be found. Jun 30 12:44:09.375772 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-130a9850-cee2-492f-8908-f0843754182d tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Request method failure captured: Jun 30 12:44:09.375772 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: request: DELETE /compute/v2.1/servers/ba748986-dc18-4e3c-98fd-f3f0a6a46e2e HTTP/1.1 Jun 30 12:44:09.375772 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Accept: application/json Jun 30 12:44:09.375772 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Accept-Encoding: identity Jun 30 12:44:09.375772 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Connection: close Jun 30 12:44:09.375772 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Content-Length: 0 Jun 30 12:44:09.375772 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Content-Type: application/json Jun 30 12:44:09.375772 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Host: 10.222.0.57 Jun 30 12:44:09.375772 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Openstack-System-Scope: None Jun 30 12:44:09.375772 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: User-Agent: python-urllib3/1.26.9 Jun 30 12:44:09.375772 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Auth-Token: gAAAAABivZmUr5nE4sldlZsaj95gPYoaAcBmGRBy3I0hmzGn3iQqv5ZAgj-BPoF3DR2aprIIyzc4pOztEbmcfd7zRGCrhNVOgSUbHkrARCCB7THaqy8PU7wn9dODyPqFpdlPJv1XzD49N3q7ykzG0OSF7WObsxYnk2T0E2GFDSZRVSwfbpGoHiI Jun 30 12:44:09.375772 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Domain-Id: None Jun 30 12:44:09.375772 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Domain-Name: None Jun 30 12:44:09.375772 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Identity-Status: Confirmed Jun 30 12:44:09.375772 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Is-Admin-Project: True Jun 30 12:44:09.375772 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Project-Domain-Id: default Jun 30 12:44:09.375772 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Project-Domain-Name: Default Jun 30 12:44:09.375772 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Project-Id: 359201313a944a8fa9881ee6fdea67e2 Jun 30 12:44:09.375772 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Project-Name: tempest-AttachVolumeNegativeTest-110304785 Jun 30 12:44:09.375772 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Role: member,reader Jun 30 12:44:09.375772 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Roles: member,reader Jun 30 12:44:09.377360 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/359201313a944a8fa9881ee6fdea67e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/359201313a944a8fa9881ee6fdea67e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_359201313a944a8fa9881ee6fdea67e2", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/359201313a944a8fa9881ee6fdea67e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 30 12:44:09.377360 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Tenant: tempest-AttachVolumeNegativeTest-110304785 Jun 30 12:44:09.377360 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Tenant-Id: 359201313a944a8fa9881ee6fdea67e2 Jun 30 12:44:09.377360 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-110304785 Jun 30 12:44:09.377360 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User: tempest-AttachVolumeNegativeTest-110304785-project Jun 30 12:44:09.377360 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User-Domain-Id: default Jun 30 12:44:09.377360 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User-Domain-Name: Default Jun 30 12:44:09.377360 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User-Id: e935f2637d124453947b3c78360567a5 Jun 30 12:44:09.377360 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User-Name: tempest-AttachVolumeNegativeTest-110304785-project Jun 30 12:44:09.377360 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: method: > Jun 30 12:44:09.377360 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: exception: Instance ba748986-dc18-4e3c-98fd-f3f0a6a46e2e could not be found. Jun 30 12:44:09.377360 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: action_args: {'id': 'ba748986-dc18-4e3c-98fd-f3f0a6a46e2e'} Jun 30 12:44:09.378231 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 12:44:09.378231 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:44:09.378231 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 12:44:09.378231 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 12:44:09.378231 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 12:44:09.378231 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 12:44:09.378231 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 12:44:09.378231 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 12:44:09.378231 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 12:44:09.378231 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 12:44:09.378231 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba748986-dc18-4e3c-98fd-f3f0a6a46e2e could not be found. Jun 30 12:44:09.378231 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:44:09.378231 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:44:09.378231 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:44:09.378231 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:44:09.378231 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:44:09.378231 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:44:09.378231 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 12:44:09.378231 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 12:44:09.378231 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 12:44:09.379650 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 12:44:09.379650 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 30 12:44:09.379650 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 30 12:44:09.379650 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 30 12:44:09.379650 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 30 12:44:09.379650 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 12:44:09.379650 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 12:44:09.379650 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 12:44:09.379650 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 12:44:09.379650 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba748986-dc18-4e3c-98fd-f3f0a6a46e2e could not be found. Jun 30 12:44:09.379650 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:44:09.379650 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:44:09.379650 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:44:09.379650 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:44:09.379650 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:44:09.379650 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:44:09.379650 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 12:44:09.379650 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 12:44:09.379650 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba748986-dc18-4e3c-98fd-f3f0a6a46e2e could not be found. Jun 30 12:44:09.379650 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:44:09.381230 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-130a9850-cee2-492f-8908-f0843754182d tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Returning 404 to user: Instance ba748986-dc18-4e3c-98fd-f3f0a6a46e2e could not be found. {{(pid=124297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 12:44:09.381230 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-130a9850-cee2-492f-8908-f0843754182d tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "DELETE /compute/v2.1/servers/ba748986-dc18-4e3c-98fd-f3f0a6a46e2e" status: 404 len: 111 microversion: 2.1 time: 0.030961 Jun 30 12:44:09.381230 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 531/1055] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 30 12:44:09 2022] DELETE /compute/v2.1/servers/ba748986-dc18-4e3c-98fd-f3f0a6a46e2e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 12:44:09.386544 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-ec78046c-2d4e-4607-afc7-cdfdda60955b tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:44:09.387160 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-ec78046c-2d4e-4607-afc7-cdfdda60955b tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: ba748986-dc18-4e3c-98fd-f3f0a6a46e2e] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:44:09.393321 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-ec78046c-2d4e-4607-afc7-cdfdda60955b tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:44:09.393767 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-ec78046c-2d4e-4607-afc7-cdfdda60955b tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:44:09.394527 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-ec78046c-2d4e-4607-afc7-cdfdda60955b tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:44:09.394967 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-ec78046c-2d4e-4607-afc7-cdfdda60955b tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:44:09.410066 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.wsgi [None req-ec78046c-2d4e-4607-afc7-cdfdda60955b tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] HTTP exception thrown: Instance ba748986-dc18-4e3c-98fd-f3f0a6a46e2e could not be found. Jun 30 12:44:09.411593 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-ec78046c-2d4e-4607-afc7-cdfdda60955b tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Request method failure captured: Jun 30 12:44:09.411593 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: request: GET /compute/v2.1/servers/ba748986-dc18-4e3c-98fd-f3f0a6a46e2e HTTP/1.1 Jun 30 12:44:09.411593 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Accept: application/json Jun 30 12:44:09.411593 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Accept-Encoding: identity Jun 30 12:44:09.411593 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Connection: close Jun 30 12:44:09.411593 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Content-Length: 0 Jun 30 12:44:09.411593 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Content-Type: application/json Jun 30 12:44:09.411593 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Host: 10.222.0.57 Jun 30 12:44:09.411593 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Openstack-System-Scope: None Jun 30 12:44:09.411593 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: User-Agent: python-urllib3/1.26.9 Jun 30 12:44:09.411593 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Auth-Token: gAAAAABivZmUr5nE4sldlZsaj95gPYoaAcBmGRBy3I0hmzGn3iQqv5ZAgj-BPoF3DR2aprIIyzc4pOztEbmcfd7zRGCrhNVOgSUbHkrARCCB7THaqy8PU7wn9dODyPqFpdlPJv1XzD49N3q7ykzG0OSF7WObsxYnk2T0E2GFDSZRVSwfbpGoHiI Jun 30 12:44:09.411593 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Domain-Id: None Jun 30 12:44:09.411593 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Domain-Name: None Jun 30 12:44:09.411593 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Identity-Status: Confirmed Jun 30 12:44:09.411593 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Is-Admin-Project: True Jun 30 12:44:09.411593 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Domain-Id: default Jun 30 12:44:09.411593 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Domain-Name: Default Jun 30 12:44:09.411593 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Id: 359201313a944a8fa9881ee6fdea67e2 Jun 30 12:44:09.411593 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Name: tempest-AttachVolumeNegativeTest-110304785 Jun 30 12:44:09.411593 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Role: member,reader Jun 30 12:44:09.411593 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Roles: member,reader Jun 30 12:44:09.413812 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/359201313a944a8fa9881ee6fdea67e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/359201313a944a8fa9881ee6fdea67e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_359201313a944a8fa9881ee6fdea67e2", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/359201313a944a8fa9881ee6fdea67e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 30 12:44:09.413812 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant: tempest-AttachVolumeNegativeTest-110304785 Jun 30 12:44:09.413812 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant-Id: 359201313a944a8fa9881ee6fdea67e2 Jun 30 12:44:09.413812 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-110304785 Jun 30 12:44:09.413812 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User: tempest-AttachVolumeNegativeTest-110304785-project Jun 30 12:44:09.413812 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Domain-Id: default Jun 30 12:44:09.413812 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Domain-Name: Default Jun 30 12:44:09.413812 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Id: e935f2637d124453947b3c78360567a5 Jun 30 12:44:09.413812 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Name: tempest-AttachVolumeNegativeTest-110304785-project Jun 30 12:44:09.413812 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: method: > Jun 30 12:44:09.413812 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: exception: Instance ba748986-dc18-4e3c-98fd-f3f0a6a46e2e could not be found. Jun 30 12:44:09.413812 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: action_args: {'id': 'ba748986-dc18-4e3c-98fd-f3f0a6a46e2e'} Jun 30 12:44:09.414922 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 12:44:09.414922 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:44:09.414922 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 12:44:09.414922 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 12:44:09.414922 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 12:44:09.414922 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 12:44:09.414922 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 12:44:09.414922 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 12:44:09.414922 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 12:44:09.414922 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 12:44:09.414922 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba748986-dc18-4e3c-98fd-f3f0a6a46e2e could not be found. Jun 30 12:44:09.414922 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:44:09.414922 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:44:09.414922 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:44:09.414922 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:44:09.414922 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:44:09.414922 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:44:09.414922 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 12:44:09.414922 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 12:44:09.414922 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 12:44:09.416872 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 12:44:09.416872 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 12:44:09.416872 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 12:44:09.416872 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 12:44:09.416872 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 12:44:09.416872 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 12:44:09.416872 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 12:44:09.416872 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba748986-dc18-4e3c-98fd-f3f0a6a46e2e could not be found. Jun 30 12:44:09.416872 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:44:09.416872 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:44:09.416872 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:44:09.416872 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:44:09.416872 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:44:09.416872 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:44:09.416872 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 12:44:09.416872 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 12:44:09.416872 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba748986-dc18-4e3c-98fd-f3f0a6a46e2e could not be found. Jun 30 12:44:09.416872 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:44:09.418353 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-ec78046c-2d4e-4607-afc7-cdfdda60955b tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Returning 404 to user: Instance ba748986-dc18-4e3c-98fd-f3f0a6a46e2e could not be found. {{(pid=124298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 12:44:09.418353 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-ec78046c-2d4e-4607-afc7-cdfdda60955b tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "GET /compute/v2.1/servers/ba748986-dc18-4e3c-98fd-f3f0a6a46e2e" status: 404 len: 111 microversion: 2.1 time: 0.030544 Jun 30 12:44:09.418353 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 525/1056] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:44:09 2022] GET /compute/v2.1/servers/ba748986-dc18-4e3c-98fd-f3f0a6a46e2e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 12:44:10.561976 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-e71777b5-8939-4892-90fd-3ac076078520 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:44:10.562509 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-e71777b5-8939-4892-90fd-3ac076078520 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: 2a572f38-474c-4395-a917-074c331a5cb7] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:44:10.569484 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-e71777b5-8939-4892-90fd-3ac076078520 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:44:10.570045 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-e71777b5-8939-4892-90fd-3ac076078520 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:44:10.570821 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-e71777b5-8939-4892-90fd-3ac076078520 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:44:10.571253 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-e71777b5-8939-4892-90fd-3ac076078520 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:44:10.585753 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.wsgi [None req-e71777b5-8939-4892-90fd-3ac076078520 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] HTTP exception thrown: Instance 2a572f38-474c-4395-a917-074c331a5cb7 could not be found. Jun 30 12:44:10.587291 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-e71777b5-8939-4892-90fd-3ac076078520 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Request method failure captured: Jun 30 12:44:10.587291 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: request: DELETE /compute/v2.1/servers/2a572f38-474c-4395-a917-074c331a5cb7 HTTP/1.1 Jun 30 12:44:10.587291 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Accept: application/json Jun 30 12:44:10.587291 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Accept-Encoding: identity Jun 30 12:44:10.587291 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Connection: close Jun 30 12:44:10.587291 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Content-Length: 0 Jun 30 12:44:10.587291 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Content-Type: application/json Jun 30 12:44:10.587291 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Host: 10.222.0.57 Jun 30 12:44:10.587291 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Openstack-System-Scope: None Jun 30 12:44:10.587291 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: User-Agent: python-urllib3/1.26.9 Jun 30 12:44:10.587291 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Auth-Token: gAAAAABivZmUr5nE4sldlZsaj95gPYoaAcBmGRBy3I0hmzGn3iQqv5ZAgj-BPoF3DR2aprIIyzc4pOztEbmcfd7zRGCrhNVOgSUbHkrARCCB7THaqy8PU7wn9dODyPqFpdlPJv1XzD49N3q7ykzG0OSF7WObsxYnk2T0E2GFDSZRVSwfbpGoHiI Jun 30 12:44:10.587291 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Domain-Id: None Jun 30 12:44:10.587291 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Domain-Name: None Jun 30 12:44:10.587291 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Identity-Status: Confirmed Jun 30 12:44:10.587291 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Is-Admin-Project: True Jun 30 12:44:10.587291 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Project-Domain-Id: default Jun 30 12:44:10.587291 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Project-Domain-Name: Default Jun 30 12:44:10.587291 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Project-Id: 359201313a944a8fa9881ee6fdea67e2 Jun 30 12:44:10.587291 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Project-Name: tempest-AttachVolumeNegativeTest-110304785 Jun 30 12:44:10.587291 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Role: member,reader Jun 30 12:44:10.587291 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Roles: member,reader Jun 30 12:44:10.588890 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/359201313a944a8fa9881ee6fdea67e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/359201313a944a8fa9881ee6fdea67e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_359201313a944a8fa9881ee6fdea67e2", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/359201313a944a8fa9881ee6fdea67e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 30 12:44:10.588890 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Tenant: tempest-AttachVolumeNegativeTest-110304785 Jun 30 12:44:10.588890 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Tenant-Id: 359201313a944a8fa9881ee6fdea67e2 Jun 30 12:44:10.588890 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-110304785 Jun 30 12:44:10.588890 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User: tempest-AttachVolumeNegativeTest-110304785-project Jun 30 12:44:10.588890 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User-Domain-Id: default Jun 30 12:44:10.588890 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User-Domain-Name: Default Jun 30 12:44:10.588890 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User-Id: e935f2637d124453947b3c78360567a5 Jun 30 12:44:10.588890 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User-Name: tempest-AttachVolumeNegativeTest-110304785-project Jun 30 12:44:10.588890 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: method: > Jun 30 12:44:10.588890 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: exception: Instance 2a572f38-474c-4395-a917-074c331a5cb7 could not be found. Jun 30 12:44:10.588890 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: action_args: {'id': '2a572f38-474c-4395-a917-074c331a5cb7'} Jun 30 12:44:10.589805 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 12:44:10.589805 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:44:10.589805 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 12:44:10.589805 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 12:44:10.589805 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 12:44:10.589805 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 12:44:10.589805 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 12:44:10.589805 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 12:44:10.589805 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 12:44:10.589805 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 12:44:10.589805 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a572f38-474c-4395-a917-074c331a5cb7 could not be found. Jun 30 12:44:10.589805 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:44:10.589805 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:44:10.589805 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:44:10.589805 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:44:10.589805 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:44:10.589805 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:44:10.589805 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 12:44:10.589805 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 12:44:10.589805 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 12:44:10.591304 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 12:44:10.591304 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 30 12:44:10.591304 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 30 12:44:10.591304 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 30 12:44:10.591304 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 30 12:44:10.591304 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 12:44:10.591304 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 12:44:10.591304 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 12:44:10.591304 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 12:44:10.591304 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a572f38-474c-4395-a917-074c331a5cb7 could not be found. Jun 30 12:44:10.591304 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:44:10.591304 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:44:10.591304 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:44:10.591304 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:44:10.591304 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:44:10.591304 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:44:10.591304 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 12:44:10.591304 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 12:44:10.591304 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a572f38-474c-4395-a917-074c331a5cb7 could not be found. Jun 30 12:44:10.591304 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:44:10.592756 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-e71777b5-8939-4892-90fd-3ac076078520 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Returning 404 to user: Instance 2a572f38-474c-4395-a917-074c331a5cb7 could not be found. {{(pid=124297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 12:44:10.592756 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-e71777b5-8939-4892-90fd-3ac076078520 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "DELETE /compute/v2.1/servers/2a572f38-474c-4395-a917-074c331a5cb7" status: 404 len: 111 microversion: 2.1 time: 0.030632 Jun 30 12:44:10.592756 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 532/1057] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 30 12:44:10 2022] DELETE /compute/v2.1/servers/2a572f38-474c-4395-a917-074c331a5cb7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 12:44:10.597035 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-77def510-fedf-4a2b-b3b5-f973c5aac8a6 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:44:10.597671 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-77def510-fedf-4a2b-b3b5-f973c5aac8a6 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] [instance: 2a572f38-474c-4395-a917-074c331a5cb7] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:44:10.604810 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-77def510-fedf-4a2b-b3b5-f973c5aac8a6 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:44:10.605270 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-77def510-fedf-4a2b-b3b5-f973c5aac8a6 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:44:10.606022 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-77def510-fedf-4a2b-b3b5-f973c5aac8a6 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:44:10.606451 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-77def510-fedf-4a2b-b3b5-f973c5aac8a6 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:44:10.620550 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.wsgi [None req-77def510-fedf-4a2b-b3b5-f973c5aac8a6 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] HTTP exception thrown: Instance 2a572f38-474c-4395-a917-074c331a5cb7 could not be found. Jun 30 12:44:10.622079 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-77def510-fedf-4a2b-b3b5-f973c5aac8a6 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Request method failure captured: Jun 30 12:44:10.622079 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: request: GET /compute/v2.1/servers/2a572f38-474c-4395-a917-074c331a5cb7 HTTP/1.1 Jun 30 12:44:10.622079 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Accept: application/json Jun 30 12:44:10.622079 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Accept-Encoding: identity Jun 30 12:44:10.622079 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Connection: close Jun 30 12:44:10.622079 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Content-Length: 0 Jun 30 12:44:10.622079 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Content-Type: application/json Jun 30 12:44:10.622079 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Host: 10.222.0.57 Jun 30 12:44:10.622079 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Openstack-System-Scope: None Jun 30 12:44:10.622079 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: User-Agent: python-urllib3/1.26.9 Jun 30 12:44:10.622079 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Auth-Token: gAAAAABivZmUr5nE4sldlZsaj95gPYoaAcBmGRBy3I0hmzGn3iQqv5ZAgj-BPoF3DR2aprIIyzc4pOztEbmcfd7zRGCrhNVOgSUbHkrARCCB7THaqy8PU7wn9dODyPqFpdlPJv1XzD49N3q7ykzG0OSF7WObsxYnk2T0E2GFDSZRVSwfbpGoHiI Jun 30 12:44:10.622079 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Domain-Id: None Jun 30 12:44:10.622079 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Domain-Name: None Jun 30 12:44:10.622079 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Identity-Status: Confirmed Jun 30 12:44:10.622079 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Is-Admin-Project: True Jun 30 12:44:10.622079 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Domain-Id: default Jun 30 12:44:10.622079 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Domain-Name: Default Jun 30 12:44:10.622079 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Id: 359201313a944a8fa9881ee6fdea67e2 Jun 30 12:44:10.622079 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Name: tempest-AttachVolumeNegativeTest-110304785 Jun 30 12:44:10.622079 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Role: member,reader Jun 30 12:44:10.622079 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Roles: member,reader Jun 30 12:44:10.623675 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/359201313a944a8fa9881ee6fdea67e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/359201313a944a8fa9881ee6fdea67e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_359201313a944a8fa9881ee6fdea67e2", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/359201313a944a8fa9881ee6fdea67e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 30 12:44:10.623675 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant: tempest-AttachVolumeNegativeTest-110304785 Jun 30 12:44:10.623675 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant-Id: 359201313a944a8fa9881ee6fdea67e2 Jun 30 12:44:10.623675 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-110304785 Jun 30 12:44:10.623675 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User: tempest-AttachVolumeNegativeTest-110304785-project Jun 30 12:44:10.623675 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Domain-Id: default Jun 30 12:44:10.623675 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Domain-Name: Default Jun 30 12:44:10.623675 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Id: e935f2637d124453947b3c78360567a5 Jun 30 12:44:10.623675 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Name: tempest-AttachVolumeNegativeTest-110304785-project Jun 30 12:44:10.623675 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: method: > Jun 30 12:44:10.623675 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: exception: Instance 2a572f38-474c-4395-a917-074c331a5cb7 could not be found. Jun 30 12:44:10.623675 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: action_args: {'id': '2a572f38-474c-4395-a917-074c331a5cb7'} Jun 30 12:44:10.624500 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 12:44:10.624500 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:44:10.624500 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 12:44:10.624500 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 12:44:10.624500 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 12:44:10.624500 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 12:44:10.624500 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 12:44:10.624500 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 12:44:10.624500 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 12:44:10.624500 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 12:44:10.624500 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a572f38-474c-4395-a917-074c331a5cb7 could not be found. Jun 30 12:44:10.624500 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:44:10.624500 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:44:10.624500 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:44:10.624500 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:44:10.624500 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:44:10.624500 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:44:10.624500 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 12:44:10.624500 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 12:44:10.624500 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 12:44:10.625920 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 12:44:10.625920 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 12:44:10.625920 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 12:44:10.625920 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 12:44:10.625920 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 12:44:10.625920 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 12:44:10.625920 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 12:44:10.625920 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a572f38-474c-4395-a917-074c331a5cb7 could not be found. Jun 30 12:44:10.625920 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:44:10.625920 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:44:10.625920 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:44:10.625920 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:44:10.625920 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:44:10.625920 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:44:10.625920 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 12:44:10.625920 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 12:44:10.625920 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a572f38-474c-4395-a917-074c331a5cb7 could not be found. Jun 30 12:44:10.625920 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:44:10.627019 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-77def510-fedf-4a2b-b3b5-f973c5aac8a6 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] Returning 404 to user: Instance 2a572f38-474c-4395-a917-074c331a5cb7 could not be found. {{(pid=124298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 12:44:10.627019 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-77def510-fedf-4a2b-b3b5-f973c5aac8a6 tempest-AttachVolumeNegativeTest-110304785 tempest-AttachVolumeNegativeTest-110304785-project] 10.222.0.57 "GET /compute/v2.1/servers/2a572f38-474c-4395-a917-074c331a5cb7" status: 404 len: 111 microversion: 2.1 time: 0.030229 Jun 30 12:44:10.627019 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 526/1058] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:44:10 2022] GET /compute/v2.1/servers/2a572f38-474c-4395-a917-074c331a5cb7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 12:44:20.343008 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-d6ab76eb-725b-452f-a6b5-a54df6ff0006 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:44:20.344376 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-d6ab76eb-725b-452f-a6b5-a54df6ff0006 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:44:20.348835 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG dbcounter [-] [124297] Writing DB stats nova_api:SELECT=24 {{(pid=124297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:44:20.353376 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-d6ab76eb-725b-452f-a6b5-a54df6ff0006 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:44:20.353926 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-d6ab76eb-725b-452f-a6b5-a54df6ff0006 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:44:20.354751 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-d6ab76eb-725b-452f-a6b5-a54df6ff0006 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:44:20.355353 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-d6ab76eb-725b-452f-a6b5-a54df6ff0006 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:44:20.358402 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG dbcounter [-] [124297] Writing DB stats nova_cell1:SELECT=52,nova_cell1:INSERT=1 {{(pid=124297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:44:20.388273 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-d6ab76eb-725b-452f-a6b5-a54df6ff0006 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049941 Jun 30 12:44:20.388952 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 533/1059] 10.222.0.57 () {60 vars in 1342 bytes} [Thu Jun 30 12:44:20 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:44:20.448814 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-0b97437d-a0bf-4287-ac89-6104109284c1 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:44:20.449431 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-0b97437d-a0bf-4287-ac89-6104109284c1 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:44:20.451936 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG dbcounter [-] [124298] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:44:20.458238 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-0b97437d-a0bf-4287-ac89-6104109284c1 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:44:20.458968 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-0b97437d-a0bf-4287-ac89-6104109284c1 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:44:20.459757 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-0b97437d-a0bf-4287-ac89-6104109284c1 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:44:20.460210 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-0b97437d-a0bf-4287-ac89-6104109284c1 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:44:20.496762 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-0b97437d-a0bf-4287-ac89-6104109284c1 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Going to try to terminate instance {{(pid=124298) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 12:44:20.576580 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-0b97437d-a0bf-4287-ac89-6104109284c1 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "DELETE /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 204 len: 0 microversion: 2.20 time: 0.131197 Jun 30 12:44:20.577326 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 527/1060] 10.222.0.57 () {60 vars in 1279 bytes} [Thu Jun 30 12:44:20 2022] DELETE /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 30 12:44:20.585771 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-93d4a801-b5d7-4326-be64-85c5edc63107 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:44:20.586383 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-93d4a801-b5d7-4326-be64-85c5edc63107 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:44:20.592888 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-93d4a801-b5d7-4326-be64-85c5edc63107 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:44:20.593342 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-93d4a801-b5d7-4326-be64-85c5edc63107 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:44:20.594111 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-93d4a801-b5d7-4326-be64-85c5edc63107 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:44:20.594554 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-93d4a801-b5d7-4326-be64-85c5edc63107 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:44:20.730074 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-93d4a801-b5d7-4326-be64-85c5edc63107 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:44:20.738340 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-93d4a801-b5d7-4326-be64-85c5edc63107 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:44:20.739871 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-93d4a801-b5d7-4326-be64-85c5edc63107 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:44:20.741072 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-93d4a801-b5d7-4326-be64-85c5edc63107 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 200 len: 1723 microversion: 2.20 time: 0.159283 Jun 30 12:44:20.741636 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 534/1061] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:44:20 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:44:21.762000 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-38062a83-56f9-41c0-ab45-4dde7555df2e tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:44:21.762608 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-38062a83-56f9-41c0-ab45-4dde7555df2e tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:44:21.769372 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-38062a83-56f9-41c0-ab45-4dde7555df2e tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:44:21.769819 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-38062a83-56f9-41c0-ab45-4dde7555df2e tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:44:21.770583 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-38062a83-56f9-41c0-ab45-4dde7555df2e tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:44:21.771015 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-38062a83-56f9-41c0-ab45-4dde7555df2e tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:44:21.908360 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-38062a83-56f9-41c0-ab45-4dde7555df2e tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:44:21.921339 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-38062a83-56f9-41c0-ab45-4dde7555df2e tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:44:21.923729 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-38062a83-56f9-41c0-ab45-4dde7555df2e tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:44:21.925585 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-38062a83-56f9-41c0-ab45-4dde7555df2e tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 200 len: 1723 microversion: 2.20 time: 0.168894 Jun 30 12:44:21.926357 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 528/1062] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:44:21 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:44:22.949128 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-ee1e84f8-a256-4308-906a-0546271acb20 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:44:22.949672 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-ee1e84f8-a256-4308-906a-0546271acb20 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:44:22.959621 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [req-71d996a7-d34f-46b8-878e-f1f8d2eea3cb req-d0faf315-a87f-42e7-9a0b-e439a6f9d644 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c79b3b73-522e-4636-bd99-234f910f3999", "name": "network-vif-deleted", "tag": "89638ae7-46a1-4d58-af0e-071e8bafd6b4"}]} {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:44:22.960213 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-ee1e84f8-a256-4308-906a-0546271acb20 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:44:22.960213 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-ee1e84f8-a256-4308-906a-0546271acb20 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:44:22.961066 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-ee1e84f8-a256-4308-906a-0546271acb20 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:44:22.961502 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-ee1e84f8-a256-4308-906a-0546271acb20 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:44:22.970726 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [req-71d996a7-d34f-46b8-878e-f1f8d2eea3cb req-d0faf315-a87f-42e7-9a0b-e439a6f9d644 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:44:22.971157 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [req-71d996a7-d34f-46b8-878e-f1f8d2eea3cb req-d0faf315-a87f-42e7-9a0b-e439a6f9d644 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:44:22.983790 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.compute.server_external_events [req-71d996a7-d34f-46b8-878e-f1f8d2eea3cb req-d0faf315-a87f-42e7-9a0b-e439a6f9d644 service nova] Creating event network-vif-deleted:89638ae7-46a1-4d58-af0e-071e8bafd6b4 for instance c79b3b73-522e-4636-bd99-234f910f3999 on hv-cinder-84614 Jun 30 12:44:22.989025 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [req-71d996a7-d34f-46b8-878e-f1f8d2eea3cb req-d0faf315-a87f-42e7-9a0b-e439a6f9d644 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032929 Jun 30 12:44:22.992693 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 529/1063] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 30 12:44:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:44:23.053229 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-ee1e84f8-a256-4308-906a-0546271acb20 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:44:23.063592 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-ee1e84f8-a256-4308-906a-0546271acb20 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:44:23.065139 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-ee1e84f8-a256-4308-906a-0546271acb20 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:44:23.066551 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-ee1e84f8-a256-4308-906a-0546271acb20 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 200 len: 1655 microversion: 2.20 time: 0.124125 Jun 30 12:44:23.077063 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 535/1064] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:44:22 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 1655 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:44:24.092540 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-c1d46be4-3381-4293-83a4-b58d1de741b2 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:44:24.093767 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-c1d46be4-3381-4293-83a4-b58d1de741b2 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:44:24.103801 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-c1d46be4-3381-4293-83a4-b58d1de741b2 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:44:24.104394 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-c1d46be4-3381-4293-83a4-b58d1de741b2 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:44:24.105128 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-c1d46be4-3381-4293-83a4-b58d1de741b2 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:44:24.105563 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-c1d46be4-3381-4293-83a4-b58d1de741b2 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:44:24.137912 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-c1d46be4-3381-4293-83a4-b58d1de741b2 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:44:24.138356 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-c1d46be4-3381-4293-83a4-b58d1de741b2 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:44:24.138802 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.objects.instance [None req-c1d46be4-3381-4293-83a4-b58d1de741b2 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lazy-loading 'fault' on Instance uuid c79b3b73-522e-4636-bd99-234f910f3999 {{(pid=124298) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 12:44:24.181603 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-c1d46be4-3381-4293-83a4-b58d1de741b2 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:44:24.189793 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-c1d46be4-3381-4293-83a4-b58d1de741b2 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:44:24.191266 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-c1d46be4-3381-4293-83a4-b58d1de741b2 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:44:24.192417 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-c1d46be4-3381-4293-83a4-b58d1de741b2 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 200 len: 1371 microversion: 2.20 time: 0.107965 Jun 30 12:44:24.192987 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 530/1065] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:44:24 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 1371 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:44:25.210888 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-a43ba573-fc08-4f90-953e-79dec632a564 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:44:25.211501 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-a43ba573-fc08-4f90-953e-79dec632a564 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:44:25.218318 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-a43ba573-fc08-4f90-953e-79dec632a564 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:44:25.218780 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-a43ba573-fc08-4f90-953e-79dec632a564 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:44:25.219547 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-a43ba573-fc08-4f90-953e-79dec632a564 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:44:25.219987 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-a43ba573-fc08-4f90-953e-79dec632a564 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:44:25.252312 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-a43ba573-fc08-4f90-953e-79dec632a564 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:44:25.252789 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-a43ba573-fc08-4f90-953e-79dec632a564 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:44:25.253236 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.objects.instance [None req-a43ba573-fc08-4f90-953e-79dec632a564 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lazy-loading 'fault' on Instance uuid c79b3b73-522e-4636-bd99-234f910f3999 {{(pid=124297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 12:44:25.303508 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-a43ba573-fc08-4f90-953e-79dec632a564 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:44:25.312103 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-a43ba573-fc08-4f90-953e-79dec632a564 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:44:25.313631 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-a43ba573-fc08-4f90-953e-79dec632a564 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7294e5eafdfc42fbac105cf58ee07b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373556d3416e4db68d08897c3d7c0a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:44:25.314796 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-a43ba573-fc08-4f90-953e-79dec632a564 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 200 len: 1371 microversion: 2.20 time: 0.107950 Jun 30 12:44:25.315403 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 536/1066] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:44:25 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 1371 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:44:26.333078 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-97495591-536f-4428-82cc-3e441f99c333 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:44:26.333756 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-97495591-536f-4428-82cc-3e441f99c333 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:44:26.340555 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-97495591-536f-4428-82cc-3e441f99c333 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:44:26.341118 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-97495591-536f-4428-82cc-3e441f99c333 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:44:26.342033 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-97495591-536f-4428-82cc-3e441f99c333 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:44:26.342548 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-97495591-536f-4428-82cc-3e441f99c333 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:44:26.356777 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.wsgi [None req-97495591-536f-4428-82cc-3e441f99c333 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] HTTP exception thrown: Instance c79b3b73-522e-4636-bd99-234f910f3999 could not be found. Jun 30 12:44:26.358558 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-97495591-536f-4428-82cc-3e441f99c333 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Request method failure captured: Jun 30 12:44:26.358558 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: request: GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 HTTP/1.1 Jun 30 12:44:26.358558 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Accept: application/json Jun 30 12:44:26.358558 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Accept-Encoding: identity Jun 30 12:44:26.358558 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Connection: close Jun 30 12:44:26.358558 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Content-Length: 0 Jun 30 12:44:26.358558 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Content-Type: application/json Jun 30 12:44:26.358558 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Host: 10.222.0.57 Jun 30 12:44:26.358558 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Openstack-System-Scope: None Jun 30 12:44:26.358558 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: User-Agent: python-urllib3/1.26.9 Jun 30 12:44:26.358558 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Auth-Token: gAAAAABivZlaROdnd5QxkhuIoGlaxhh9_EvN9eNIc_8LDYjg8V94kYmSU5e1iPhpmwjGkeXlkqYNLOLauzfNQDlsXSZqYUyhNM8J47t8EIhIxNxWP2BFWfaOBSOeqSERhbG0jEoM9EadjaUhpukMX6UUoAtVKdwdCytF35PJxrzChA4U1rdtl1E Jun 30 12:44:26.358558 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Domain-Id: None Jun 30 12:44:26.358558 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Domain-Name: None Jun 30 12:44:26.358558 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Identity-Status: Confirmed Jun 30 12:44:26.358558 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Is-Admin-Project: True Jun 30 12:44:26.358558 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Openstack-Nova-Api-Version: 2.20 Jun 30 12:44:26.358558 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Domain-Id: default Jun 30 12:44:26.358558 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Domain-Name: Default Jun 30 12:44:26.358558 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Id: 373556d3416e4db68d08897c3d7c0a54 Jun 30 12:44:26.358558 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-627819037 Jun 30 12:44:26.358558 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Role: member,reader Jun 30 12:44:26.358558 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Roles: member,reader Jun 30 12:44:26.360334 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/373556d3416e4db68d08897c3d7c0a54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/373556d3416e4db68d08897c3d7c0a54"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_373556d3416e4db68d08897c3d7c0a54", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/373556d3416e4db68d08897c3d7c0a54"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 30 12:44:26.360334 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant: tempest-AttachVolumeShelveTestJSON-627819037 Jun 30 12:44:26.360334 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant-Id: 373556d3416e4db68d08897c3d7c0a54 Jun 30 12:44:26.360334 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-627819037 Jun 30 12:44:26.360334 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User: tempest-AttachVolumeShelveTestJSON-627819037-project Jun 30 12:44:26.360334 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Domain-Id: default Jun 30 12:44:26.360334 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Domain-Name: Default Jun 30 12:44:26.360334 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Id: 7294e5eafdfc42fbac105cf58ee07b70 Jun 30 12:44:26.360334 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Name: tempest-AttachVolumeShelveTestJSON-627819037-project Jun 30 12:44:26.360334 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: method: > Jun 30 12:44:26.360334 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: exception: Instance c79b3b73-522e-4636-bd99-234f910f3999 could not be found. Jun 30 12:44:26.360334 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: action_args: {'id': 'c79b3b73-522e-4636-bd99-234f910f3999'} Jun 30 12:44:26.361356 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 12:44:26.361356 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:44:26.361356 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 12:44:26.361356 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 12:44:26.361356 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 12:44:26.361356 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 12:44:26.361356 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 12:44:26.361356 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 12:44:26.361356 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 12:44:26.361356 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 12:44:26.361356 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c79b3b73-522e-4636-bd99-234f910f3999 could not be found. Jun 30 12:44:26.361356 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:44:26.361356 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:44:26.361356 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:44:26.361356 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:44:26.361356 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:44:26.361356 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:44:26.361356 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 12:44:26.361356 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 12:44:26.361356 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 12:44:26.363180 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 12:44:26.363180 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 12:44:26.363180 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 12:44:26.363180 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 12:44:26.363180 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 12:44:26.363180 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 12:44:26.363180 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 12:44:26.363180 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c79b3b73-522e-4636-bd99-234f910f3999 could not be found. Jun 30 12:44:26.363180 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:44:26.363180 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:44:26.363180 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:44:26.363180 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:44:26.363180 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:44:26.363180 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:44:26.363180 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 12:44:26.363180 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 12:44:26.363180 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c79b3b73-522e-4636-bd99-234f910f3999 could not be found. Jun 30 12:44:26.363180 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:44:26.364369 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-97495591-536f-4428-82cc-3e441f99c333 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Returning 404 to user: Instance c79b3b73-522e-4636-bd99-234f910f3999 could not be found. {{(pid=124298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 12:44:26.364369 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-97495591-536f-4428-82cc-3e441f99c333 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 404 len: 111 microversion: 2.20 time: 0.032162 Jun 30 12:44:26.364369 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 531/1067] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:44:26 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 30 12:44:26.370976 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-acd779fc-6185-49ad-b61d-a0cdc1a71f73 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '.version_select at 0x7fd0e04f24c0>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:44:26.390521 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-acd779fc-6185-49ad-b61d-a0cdc1a71f73 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-413530922" status: 204 len: 0 microversion: 2.20 time: 0.023590 Jun 30 12:44:26.391104 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 537/1068] 10.222.0.57 () {60 vars in 1258 bytes} [Thu Jun 30 12:44:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-413530922 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 30 12:44:28.198663 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-e18fbd61-4ace-444a-842a-ecec032198d5 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:44:28.199147 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-e18fbd61-4ace-444a-842a-ecec032198d5 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:44:28.206447 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-e18fbd61-4ace-444a-842a-ecec032198d5 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:44:28.206895 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-e18fbd61-4ace-444a-842a-ecec032198d5 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:44:28.207656 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-e18fbd61-4ace-444a-842a-ecec032198d5 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:44:28.208157 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-e18fbd61-4ace-444a-842a-ecec032198d5 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:44:28.222081 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.wsgi [None req-e18fbd61-4ace-444a-842a-ecec032198d5 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] HTTP exception thrown: Instance c79b3b73-522e-4636-bd99-234f910f3999 could not be found. Jun 30 12:44:28.223658 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-e18fbd61-4ace-444a-842a-ecec032198d5 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Request method failure captured: Jun 30 12:44:28.223658 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: request: DELETE /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 HTTP/1.1 Jun 30 12:44:28.223658 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Accept: application/json Jun 30 12:44:28.223658 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Accept-Encoding: identity Jun 30 12:44:28.223658 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Connection: close Jun 30 12:44:28.223658 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Content-Length: 0 Jun 30 12:44:28.223658 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Content-Type: application/json Jun 30 12:44:28.223658 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Host: 10.222.0.57 Jun 30 12:44:28.223658 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Openstack-System-Scope: None Jun 30 12:44:28.223658 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: User-Agent: python-urllib3/1.26.9 Jun 30 12:44:28.223658 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Auth-Token: gAAAAABivZlaROdnd5QxkhuIoGlaxhh9_EvN9eNIc_8LDYjg8V94kYmSU5e1iPhpmwjGkeXlkqYNLOLauzfNQDlsXSZqYUyhNM8J47t8EIhIxNxWP2BFWfaOBSOeqSERhbG0jEoM9EadjaUhpukMX6UUoAtVKdwdCytF35PJxrzChA4U1rdtl1E Jun 30 12:44:28.223658 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Domain-Id: None Jun 30 12:44:28.223658 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Domain-Name: None Jun 30 12:44:28.223658 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Identity-Status: Confirmed Jun 30 12:44:28.223658 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Is-Admin-Project: True Jun 30 12:44:28.223658 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Openstack-Nova-Api-Version: 2.20 Jun 30 12:44:28.223658 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Domain-Id: default Jun 30 12:44:28.223658 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Domain-Name: Default Jun 30 12:44:28.223658 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Id: 373556d3416e4db68d08897c3d7c0a54 Jun 30 12:44:28.223658 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-627819037 Jun 30 12:44:28.223658 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Role: member,reader Jun 30 12:44:28.223658 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Roles: member,reader Jun 30 12:44:28.225341 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/373556d3416e4db68d08897c3d7c0a54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/373556d3416e4db68d08897c3d7c0a54"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_373556d3416e4db68d08897c3d7c0a54", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/373556d3416e4db68d08897c3d7c0a54"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 30 12:44:28.225341 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant: tempest-AttachVolumeShelveTestJSON-627819037 Jun 30 12:44:28.225341 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant-Id: 373556d3416e4db68d08897c3d7c0a54 Jun 30 12:44:28.225341 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-627819037 Jun 30 12:44:28.225341 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User: tempest-AttachVolumeShelveTestJSON-627819037-project Jun 30 12:44:28.225341 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Domain-Id: default Jun 30 12:44:28.225341 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Domain-Name: Default Jun 30 12:44:28.225341 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Id: 7294e5eafdfc42fbac105cf58ee07b70 Jun 30 12:44:28.225341 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Name: tempest-AttachVolumeShelveTestJSON-627819037-project Jun 30 12:44:28.225341 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: method: > Jun 30 12:44:28.225341 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: exception: Instance c79b3b73-522e-4636-bd99-234f910f3999 could not be found. Jun 30 12:44:28.225341 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: action_args: {'id': 'c79b3b73-522e-4636-bd99-234f910f3999'} Jun 30 12:44:28.226256 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 12:44:28.226256 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:44:28.226256 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 12:44:28.226256 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 12:44:28.226256 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 12:44:28.226256 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 12:44:28.226256 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 12:44:28.226256 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 12:44:28.226256 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 12:44:28.226256 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 12:44:28.226256 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c79b3b73-522e-4636-bd99-234f910f3999 could not be found. Jun 30 12:44:28.226256 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:44:28.226256 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:44:28.226256 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:44:28.226256 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:44:28.226256 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:44:28.226256 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:44:28.226256 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 12:44:28.226256 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 12:44:28.226256 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 12:44:28.227729 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 12:44:28.227729 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 30 12:44:28.227729 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 30 12:44:28.227729 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 30 12:44:28.227729 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 30 12:44:28.227729 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 12:44:28.227729 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 12:44:28.227729 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 12:44:28.227729 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 12:44:28.227729 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c79b3b73-522e-4636-bd99-234f910f3999 could not be found. Jun 30 12:44:28.227729 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:44:28.227729 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:44:28.227729 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:44:28.227729 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:44:28.227729 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:44:28.227729 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:44:28.227729 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 12:44:28.227729 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 12:44:28.227729 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c79b3b73-522e-4636-bd99-234f910f3999 could not be found. Jun 30 12:44:28.227729 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:44:28.229301 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-e18fbd61-4ace-444a-842a-ecec032198d5 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Returning 404 to user: Instance c79b3b73-522e-4636-bd99-234f910f3999 could not be found. {{(pid=124298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 12:44:28.229301 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-e18fbd61-4ace-444a-842a-ecec032198d5 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "DELETE /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 404 len: 111 microversion: 2.20 time: 0.030330 Jun 30 12:44:28.229301 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 532/1069] 10.222.0.57 () {60 vars in 1279 bytes} [Thu Jun 30 12:44:28 2022] DELETE /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 30 12:44:28.234328 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-7d1186cc-ef52-4292-be62-97980b459bc0 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:44:28.234936 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-7d1186cc-ef52-4292-be62-97980b459bc0 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: c79b3b73-522e-4636-bd99-234f910f3999] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:44:28.242258 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-7d1186cc-ef52-4292-be62-97980b459bc0 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:44:28.242717 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-7d1186cc-ef52-4292-be62-97980b459bc0 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:44:28.243498 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-7d1186cc-ef52-4292-be62-97980b459bc0 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:44:28.243931 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-7d1186cc-ef52-4292-be62-97980b459bc0 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:44:28.257563 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.wsgi [None req-7d1186cc-ef52-4292-be62-97980b459bc0 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] HTTP exception thrown: Instance c79b3b73-522e-4636-bd99-234f910f3999 could not be found. Jun 30 12:44:28.259109 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-7d1186cc-ef52-4292-be62-97980b459bc0 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Request method failure captured: Jun 30 12:44:28.259109 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: request: GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 HTTP/1.1 Jun 30 12:44:28.259109 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Accept: application/json Jun 30 12:44:28.259109 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Accept-Encoding: identity Jun 30 12:44:28.259109 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Connection: close Jun 30 12:44:28.259109 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Content-Length: 0 Jun 30 12:44:28.259109 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Content-Type: application/json Jun 30 12:44:28.259109 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Host: 10.222.0.57 Jun 30 12:44:28.259109 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Openstack-System-Scope: None Jun 30 12:44:28.259109 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: User-Agent: python-urllib3/1.26.9 Jun 30 12:44:28.259109 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Auth-Token: gAAAAABivZlaROdnd5QxkhuIoGlaxhh9_EvN9eNIc_8LDYjg8V94kYmSU5e1iPhpmwjGkeXlkqYNLOLauzfNQDlsXSZqYUyhNM8J47t8EIhIxNxWP2BFWfaOBSOeqSERhbG0jEoM9EadjaUhpukMX6UUoAtVKdwdCytF35PJxrzChA4U1rdtl1E Jun 30 12:44:28.259109 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Domain-Id: None Jun 30 12:44:28.259109 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Domain-Name: None Jun 30 12:44:28.259109 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Identity-Status: Confirmed Jun 30 12:44:28.259109 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Is-Admin-Project: True Jun 30 12:44:28.259109 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Openstack-Nova-Api-Version: 2.20 Jun 30 12:44:28.259109 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Project-Domain-Id: default Jun 30 12:44:28.259109 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Project-Domain-Name: Default Jun 30 12:44:28.259109 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Project-Id: 373556d3416e4db68d08897c3d7c0a54 Jun 30 12:44:28.259109 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-627819037 Jun 30 12:44:28.259109 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Role: member,reader Jun 30 12:44:28.259109 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Roles: member,reader Jun 30 12:44:28.260849 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/373556d3416e4db68d08897c3d7c0a54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/373556d3416e4db68d08897c3d7c0a54"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_373556d3416e4db68d08897c3d7c0a54", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/373556d3416e4db68d08897c3d7c0a54"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 30 12:44:28.260849 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Tenant: tempest-AttachVolumeShelveTestJSON-627819037 Jun 30 12:44:28.260849 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Tenant-Id: 373556d3416e4db68d08897c3d7c0a54 Jun 30 12:44:28.260849 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-627819037 Jun 30 12:44:28.260849 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User: tempest-AttachVolumeShelveTestJSON-627819037-project Jun 30 12:44:28.260849 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User-Domain-Id: default Jun 30 12:44:28.260849 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User-Domain-Name: Default Jun 30 12:44:28.260849 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User-Id: 7294e5eafdfc42fbac105cf58ee07b70 Jun 30 12:44:28.260849 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User-Name: tempest-AttachVolumeShelveTestJSON-627819037-project Jun 30 12:44:28.260849 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: method: > Jun 30 12:44:28.260849 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: exception: Instance c79b3b73-522e-4636-bd99-234f910f3999 could not be found. Jun 30 12:44:28.260849 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: action_args: {'id': 'c79b3b73-522e-4636-bd99-234f910f3999'} Jun 30 12:44:28.261721 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 12:44:28.261721 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:44:28.261721 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 12:44:28.261721 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 12:44:28.261721 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 12:44:28.261721 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 12:44:28.261721 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 12:44:28.261721 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 12:44:28.261721 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 12:44:28.261721 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 12:44:28.261721 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c79b3b73-522e-4636-bd99-234f910f3999 could not be found. Jun 30 12:44:28.261721 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:44:28.261721 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:44:28.261721 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:44:28.261721 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:44:28.261721 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:44:28.261721 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:44:28.261721 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 12:44:28.261721 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 12:44:28.261721 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 12:44:28.263474 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 12:44:28.263474 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 12:44:28.263474 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 12:44:28.263474 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 12:44:28.263474 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 12:44:28.263474 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 12:44:28.263474 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 12:44:28.263474 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c79b3b73-522e-4636-bd99-234f910f3999 could not be found. Jun 30 12:44:28.263474 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:44:28.263474 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:44:28.263474 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:44:28.263474 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:44:28.263474 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:44:28.263474 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:44:28.263474 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 12:44:28.263474 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 12:44:28.263474 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c79b3b73-522e-4636-bd99-234f910f3999 could not be found. Jun 30 12:44:28.263474 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:44:28.264838 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-7d1186cc-ef52-4292-be62-97980b459bc0 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Returning 404 to user: Instance c79b3b73-522e-4636-bd99-234f910f3999 could not be found. {{(pid=124297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 12:44:28.264838 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-7d1186cc-ef52-4292-be62-97980b459bc0 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999" status: 404 len: 111 microversion: 2.20 time: 0.030820 Jun 30 12:44:28.264838 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 538/1070] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:44:28 2022] GET /compute/v2.1/servers/c79b3b73-522e-4636-bd99-234f910f3999 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 30 12:44:29.403188 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-20c59139-1aa0-41ab-94f0-bc5d80161b50 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:44:29.403776 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-20c59139-1aa0-41ab-94f0-bc5d80161b50 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: 8d6c9ce4-3de7-47d1-8e5a-1abe9091129e] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:44:29.410331 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-20c59139-1aa0-41ab-94f0-bc5d80161b50 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:44:29.410783 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-20c59139-1aa0-41ab-94f0-bc5d80161b50 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:44:29.411553 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-20c59139-1aa0-41ab-94f0-bc5d80161b50 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:44:29.411990 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-20c59139-1aa0-41ab-94f0-bc5d80161b50 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:44:29.425924 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.wsgi [None req-20c59139-1aa0-41ab-94f0-bc5d80161b50 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] HTTP exception thrown: Instance 8d6c9ce4-3de7-47d1-8e5a-1abe9091129e could not be found. Jun 30 12:44:29.427551 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-20c59139-1aa0-41ab-94f0-bc5d80161b50 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Request method failure captured: Jun 30 12:44:29.427551 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: request: DELETE /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e HTTP/1.1 Jun 30 12:44:29.427551 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Accept: application/json Jun 30 12:44:29.427551 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Accept-Encoding: identity Jun 30 12:44:29.427551 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Connection: close Jun 30 12:44:29.427551 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Content-Length: 0 Jun 30 12:44:29.427551 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Content-Type: application/json Jun 30 12:44:29.427551 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Host: 10.222.0.57 Jun 30 12:44:29.427551 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Openstack-System-Scope: None Jun 30 12:44:29.427551 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: User-Agent: python-urllib3/1.26.9 Jun 30 12:44:29.427551 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Auth-Token: gAAAAABivZlaROdnd5QxkhuIoGlaxhh9_EvN9eNIc_8LDYjg8V94kYmSU5e1iPhpmwjGkeXlkqYNLOLauzfNQDlsXSZqYUyhNM8J47t8EIhIxNxWP2BFWfaOBSOeqSERhbG0jEoM9EadjaUhpukMX6UUoAtVKdwdCytF35PJxrzChA4U1rdtl1E Jun 30 12:44:29.427551 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Domain-Id: None Jun 30 12:44:29.427551 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Domain-Name: None Jun 30 12:44:29.427551 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Identity-Status: Confirmed Jun 30 12:44:29.427551 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Is-Admin-Project: True Jun 30 12:44:29.427551 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Openstack-Nova-Api-Version: 2.20 Jun 30 12:44:29.427551 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Domain-Id: default Jun 30 12:44:29.427551 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Domain-Name: Default Jun 30 12:44:29.427551 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Id: 373556d3416e4db68d08897c3d7c0a54 Jun 30 12:44:29.427551 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-627819037 Jun 30 12:44:29.427551 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Role: member,reader Jun 30 12:44:29.427551 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Roles: member,reader Jun 30 12:44:29.429218 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/373556d3416e4db68d08897c3d7c0a54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/373556d3416e4db68d08897c3d7c0a54"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_373556d3416e4db68d08897c3d7c0a54", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/373556d3416e4db68d08897c3d7c0a54"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 30 12:44:29.429218 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant: tempest-AttachVolumeShelveTestJSON-627819037 Jun 30 12:44:29.429218 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant-Id: 373556d3416e4db68d08897c3d7c0a54 Jun 30 12:44:29.429218 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-627819037 Jun 30 12:44:29.429218 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User: tempest-AttachVolumeShelveTestJSON-627819037-project Jun 30 12:44:29.429218 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Domain-Id: default Jun 30 12:44:29.429218 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Domain-Name: Default Jun 30 12:44:29.429218 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Id: 7294e5eafdfc42fbac105cf58ee07b70 Jun 30 12:44:29.429218 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Name: tempest-AttachVolumeShelveTestJSON-627819037-project Jun 30 12:44:29.429218 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: method: > Jun 30 12:44:29.429218 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: exception: Instance 8d6c9ce4-3de7-47d1-8e5a-1abe9091129e could not be found. Jun 30 12:44:29.429218 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: action_args: {'id': '8d6c9ce4-3de7-47d1-8e5a-1abe9091129e'} Jun 30 12:44:29.430007 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 12:44:29.430007 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:44:29.430007 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 12:44:29.430007 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 12:44:29.430007 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 12:44:29.430007 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 12:44:29.430007 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 12:44:29.430007 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 12:44:29.430007 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 12:44:29.430007 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 12:44:29.430007 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d6c9ce4-3de7-47d1-8e5a-1abe9091129e could not be found. Jun 30 12:44:29.430007 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:44:29.430007 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:44:29.430007 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:44:29.430007 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:44:29.430007 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:44:29.430007 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:44:29.430007 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 12:44:29.430007 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 12:44:29.430007 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 12:44:29.431366 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 12:44:29.431366 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 30 12:44:29.431366 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 30 12:44:29.431366 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 30 12:44:29.431366 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 30 12:44:29.431366 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 12:44:29.431366 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 12:44:29.431366 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 12:44:29.431366 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 12:44:29.431366 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d6c9ce4-3de7-47d1-8e5a-1abe9091129e could not be found. Jun 30 12:44:29.431366 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:44:29.431366 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:44:29.431366 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:44:29.431366 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:44:29.431366 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:44:29.431366 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:44:29.431366 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 12:44:29.431366 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 12:44:29.431366 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d6c9ce4-3de7-47d1-8e5a-1abe9091129e could not be found. Jun 30 12:44:29.431366 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:44:29.433889 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-20c59139-1aa0-41ab-94f0-bc5d80161b50 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Returning 404 to user: Instance 8d6c9ce4-3de7-47d1-8e5a-1abe9091129e could not be found. {{(pid=124298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 12:44:29.433889 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-20c59139-1aa0-41ab-94f0-bc5d80161b50 tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "DELETE /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e" status: 404 len: 111 microversion: 2.20 time: 0.029810 Jun 30 12:44:29.433889 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 533/1071] 10.222.0.57 () {60 vars in 1279 bytes} [Thu Jun 30 12:44:29 2022] DELETE /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 30 12:44:29.437937 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-edb34e07-980b-459a-95b7-d12542bdaefd tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:44:29.438544 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-edb34e07-980b-459a-95b7-d12542bdaefd tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] [instance: 8d6c9ce4-3de7-47d1-8e5a-1abe9091129e] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:44:29.445401 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-edb34e07-980b-459a-95b7-d12542bdaefd tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:44:29.445848 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-edb34e07-980b-459a-95b7-d12542bdaefd tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:44:29.446623 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-edb34e07-980b-459a-95b7-d12542bdaefd tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:44:29.447061 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-edb34e07-980b-459a-95b7-d12542bdaefd tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:44:29.460755 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.wsgi [None req-edb34e07-980b-459a-95b7-d12542bdaefd tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] HTTP exception thrown: Instance 8d6c9ce4-3de7-47d1-8e5a-1abe9091129e could not be found. Jun 30 12:44:29.462283 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-edb34e07-980b-459a-95b7-d12542bdaefd tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Request method failure captured: Jun 30 12:44:29.462283 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: request: GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e HTTP/1.1 Jun 30 12:44:29.462283 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Accept: application/json Jun 30 12:44:29.462283 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Accept-Encoding: identity Jun 30 12:44:29.462283 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Connection: close Jun 30 12:44:29.462283 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Content-Length: 0 Jun 30 12:44:29.462283 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Content-Type: application/json Jun 30 12:44:29.462283 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Host: 10.222.0.57 Jun 30 12:44:29.462283 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Openstack-System-Scope: None Jun 30 12:44:29.462283 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: User-Agent: python-urllib3/1.26.9 Jun 30 12:44:29.462283 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Auth-Token: gAAAAABivZlaROdnd5QxkhuIoGlaxhh9_EvN9eNIc_8LDYjg8V94kYmSU5e1iPhpmwjGkeXlkqYNLOLauzfNQDlsXSZqYUyhNM8J47t8EIhIxNxWP2BFWfaOBSOeqSERhbG0jEoM9EadjaUhpukMX6UUoAtVKdwdCytF35PJxrzChA4U1rdtl1E Jun 30 12:44:29.462283 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Domain-Id: None Jun 30 12:44:29.462283 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Domain-Name: None Jun 30 12:44:29.462283 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Identity-Status: Confirmed Jun 30 12:44:29.462283 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Is-Admin-Project: True Jun 30 12:44:29.462283 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Openstack-Nova-Api-Version: 2.20 Jun 30 12:44:29.462283 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Project-Domain-Id: default Jun 30 12:44:29.462283 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Project-Domain-Name: Default Jun 30 12:44:29.462283 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Project-Id: 373556d3416e4db68d08897c3d7c0a54 Jun 30 12:44:29.462283 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-627819037 Jun 30 12:44:29.462283 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Role: member,reader Jun 30 12:44:29.462283 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Roles: member,reader Jun 30 12:44:29.463967 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/373556d3416e4db68d08897c3d7c0a54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/373556d3416e4db68d08897c3d7c0a54"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_373556d3416e4db68d08897c3d7c0a54", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/373556d3416e4db68d08897c3d7c0a54"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 30 12:44:29.463967 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Tenant: tempest-AttachVolumeShelveTestJSON-627819037 Jun 30 12:44:29.463967 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Tenant-Id: 373556d3416e4db68d08897c3d7c0a54 Jun 30 12:44:29.463967 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-627819037 Jun 30 12:44:29.463967 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User: tempest-AttachVolumeShelveTestJSON-627819037-project Jun 30 12:44:29.463967 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User-Domain-Id: default Jun 30 12:44:29.463967 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User-Domain-Name: Default Jun 30 12:44:29.463967 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User-Id: 7294e5eafdfc42fbac105cf58ee07b70 Jun 30 12:44:29.463967 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: X-User-Name: tempest-AttachVolumeShelveTestJSON-627819037-project Jun 30 12:44:29.463967 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: method: > Jun 30 12:44:29.463967 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: exception: Instance 8d6c9ce4-3de7-47d1-8e5a-1abe9091129e could not be found. Jun 30 12:44:29.463967 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: action_args: {'id': '8d6c9ce4-3de7-47d1-8e5a-1abe9091129e'} Jun 30 12:44:29.464885 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 12:44:29.464885 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:44:29.464885 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 12:44:29.464885 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 12:44:29.464885 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 12:44:29.464885 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 12:44:29.464885 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 12:44:29.464885 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 12:44:29.464885 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 12:44:29.464885 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 12:44:29.464885 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d6c9ce4-3de7-47d1-8e5a-1abe9091129e could not be found. Jun 30 12:44:29.464885 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:44:29.464885 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:44:29.464885 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:44:29.464885 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:44:29.464885 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:44:29.464885 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:44:29.464885 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 12:44:29.464885 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 12:44:29.464885 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 12:44:29.466286 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 12:44:29.466286 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 12:44:29.466286 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 12:44:29.466286 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 12:44:29.466286 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 12:44:29.466286 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 12:44:29.466286 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 12:44:29.466286 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d6c9ce4-3de7-47d1-8e5a-1abe9091129e could not be found. Jun 30 12:44:29.466286 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:44:29.466286 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:44:29.466286 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:44:29.466286 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:44:29.466286 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:44:29.466286 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:44:29.466286 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 12:44:29.466286 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 12:44:29.466286 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d6c9ce4-3de7-47d1-8e5a-1abe9091129e could not be found. Jun 30 12:44:29.466286 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: ERROR nova.api.openstack.wsgi Jun 30 12:44:29.467525 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-edb34e07-980b-459a-95b7-d12542bdaefd tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] Returning 404 to user: Instance 8d6c9ce4-3de7-47d1-8e5a-1abe9091129e could not be found. {{(pid=124297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 12:44:29.467525 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-edb34e07-980b-459a-95b7-d12542bdaefd tempest-AttachVolumeShelveTestJSON-627819037 tempest-AttachVolumeShelveTestJSON-627819037-project] 10.222.0.57 "GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e" status: 404 len: 111 microversion: 2.20 time: 0.030007 Jun 30 12:44:29.467525 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 539/1072] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 30 12:44:29 2022] GET /compute/v2.1/servers/8d6c9ce4-3de7-47d1-8e5a-1abe9091129e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 30 12:44:43.455686 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-4f147b33-ef93-4fed-a9ed-7ef173da4307 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1735110827", "imageRef": "776a1662-a241-4e20-9a9c-e4743c64efd0", "flavorRef": "452", "networks": [{"uuid": "17b86a73-5b74-4e4c-b0f6-b1b2a3e377c3"}]}} {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:44:43.461306 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG dbcounter [-] [124298] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=124298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:44:43.461963 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG dbcounter [-] [124298] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:44:43.517680 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.network.neutron [None req-4f147b33-ef93-4fed-a9ed-7ef173da4307 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] validate_networks() for [('17b86a73-5b74-4e4c-b0f6-b1b2a3e377c3', None, None, None, None, None)] {{(pid=124298) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 12:44:43.893117 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.virt.hardware [None req-4f147b33-ef93-4fed-a9ed-7ef173da4307 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Flavor limits 0:0:0 {{(pid=124298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 12:44:43.893572 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.virt.hardware [None req-4f147b33-ef93-4fed-a9ed-7ef173da4307 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Image limits 0:0:0 {{(pid=124298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 12:44:43.894050 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.virt.hardware [None req-4f147b33-ef93-4fed-a9ed-7ef173da4307 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Flavor pref 0:0:0 {{(pid=124298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 12:44:43.894460 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.virt.hardware [None req-4f147b33-ef93-4fed-a9ed-7ef173da4307 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Image pref 0:0:0 {{(pid=124298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 12:44:43.894887 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.virt.hardware [None req-4f147b33-ef93-4fed-a9ed-7ef173da4307 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 12:44:43.904576 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-4f147b33-ef93-4fed-a9ed-7ef173da4307 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:44:43.905066 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-4f147b33-ef93-4fed-a9ed-7ef173da4307 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:44:43.905873 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-4f147b33-ef93-4fed-a9ed-7ef173da4307 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:44:43.906313 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-4f147b33-ef93-4fed-a9ed-7ef173da4307 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:44:43.923177 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.quota [None req-4f147b33-ef93-4fed-a9ed-7ef173da4307 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Getting quotas for project b9ebc78f23044b98a13e5e3ebc5dd614. Resources: {'cores', 'ram', 'instances'} {{(pid=124298) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 12:44:43.927398 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.quota [None req-4f147b33-ef93-4fed-a9ed-7ef173da4307 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Getting quotas for user 6b952a9d6bad40c4b2829256bed0e017 and project b9ebc78f23044b98a13e5e3ebc5dd614. Resources: {'cores', 'ram', 'instances'} {{(pid=124298) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 12:44:43.938802 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-4f147b33-ef93-4fed-a9ed-7ef173da4307 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Going to run 1 instances... {{(pid=124298) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 12:44:43.941093 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-4f147b33-ef93-4fed-a9ed-7ef173da4307 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] [instance: c9a9e592-2c6c-41df-ae1b-2343a744a5c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='776a1662-a241-4e20-9a9c-e4743c64efd0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124298) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 12:44:43.987441 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-4f147b33-ef93-4fed-a9ed-7ef173da4307 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.538149 Jun 30 12:44:43.988080 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 534/1073] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 30 12:44:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 540 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 12:44:43.998144 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-25c56505-3664-42db-9ba2-532855a537c8 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:44:43.998742 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-25c56505-3664-42db-9ba2-532855a537c8 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] [instance: c9a9e592-2c6c-41df-ae1b-2343a744a5c0] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:44:44.001288 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG dbcounter [-] [124297] Writing DB stats nova_api:SELECT=16,nova_api:DELETE=1 {{(pid=124297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:44:44.001954 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG dbcounter [-] [124297] Writing DB stats nova_cell1:SELECT=29 {{(pid=124297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:44:44.057168 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-25c56505-3664-42db-9ba2-532855a537c8 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b952a9d6bad40c4b2829256bed0e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ebc78f23044b98a13e5e3ebc5dd614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:44:44.063945 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-25c56505-3664-42db-9ba2-532855a537c8 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] 10.222.0.57 "GET /compute/v2.1/servers/c9a9e592-2c6c-41df-ae1b-2343a744a5c0" status: 200 len: 1214 microversion: 2.1 time: 0.069783 Jun 30 12:44:44.064664 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 540/1074] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:44:43 2022] GET /compute/v2.1/servers/c9a9e592-2c6c-41df-ae1b-2343a744a5c0 => generated 1214 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:44:45.082279 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-43cb24df-b54f-46c2-b4f3-9a94b60578b6 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:44:45.082904 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-43cb24df-b54f-46c2-b4f3-9a94b60578b6 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] [instance: c9a9e592-2c6c-41df-ae1b-2343a744a5c0] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:44:45.090388 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-43cb24df-b54f-46c2-b4f3-9a94b60578b6 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:44:45.090830 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-43cb24df-b54f-46c2-b4f3-9a94b60578b6 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:44:45.091608 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-43cb24df-b54f-46c2-b4f3-9a94b60578b6 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:44:45.092291 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-43cb24df-b54f-46c2-b4f3-9a94b60578b6 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:44:45.179897 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-43cb24df-b54f-46c2-b4f3-9a94b60578b6 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b952a9d6bad40c4b2829256bed0e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ebc78f23044b98a13e5e3ebc5dd614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:44:45.188505 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-43cb24df-b54f-46c2-b4f3-9a94b60578b6 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] 10.222.0.57 "GET /compute/v2.1/servers/c9a9e592-2c6c-41df-ae1b-2343a744a5c0" status: 200 len: 1272 microversion: 2.1 time: 0.111446 Jun 30 12:44:45.189123 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 535/1075] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:44:45 2022] GET /compute/v2.1/servers/c9a9e592-2c6c-41df-ae1b-2343a744a5c0 => generated 1272 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:44:46.205512 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-b33a3c90-34c6-466d-a2e6-686f1f8a9bba tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:44:46.206127 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-b33a3c90-34c6-466d-a2e6-686f1f8a9bba tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] [instance: c9a9e592-2c6c-41df-ae1b-2343a744a5c0] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:44:46.213362 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-b33a3c90-34c6-466d-a2e6-686f1f8a9bba tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:44:46.213827 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-b33a3c90-34c6-466d-a2e6-686f1f8a9bba tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:44:46.214594 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-b33a3c90-34c6-466d-a2e6-686f1f8a9bba tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:44:46.215034 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-b33a3c90-34c6-466d-a2e6-686f1f8a9bba tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:44:46.394276 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-b33a3c90-34c6-466d-a2e6-686f1f8a9bba tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b952a9d6bad40c4b2829256bed0e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ebc78f23044b98a13e5e3ebc5dd614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:44:46.402334 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-b33a3c90-34c6-466d-a2e6-686f1f8a9bba tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] 10.222.0.57 "GET /compute/v2.1/servers/c9a9e592-2c6c-41df-ae1b-2343a744a5c0" status: 200 len: 1314 microversion: 2.1 time: 0.200839 Jun 30 12:44:46.402898 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 541/1076] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:44:46 2022] GET /compute/v2.1/servers/c9a9e592-2c6c-41df-ae1b-2343a744a5c0 => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:44:46.584970 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [req-52557b49-8098-4d51-8b7b-52448b5f1d6f req-466f4396-c83c-4325-b570-96f731557e6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9a9e592-2c6c-41df-ae1b-2343a744a5c0", "tag": "8871fbf1-bd05-439a-8a3c-b5bf4f3ec481"}]} {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:44:46.594554 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [req-52557b49-8098-4d51-8b7b-52448b5f1d6f req-466f4396-c83c-4325-b570-96f731557e6a service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:44:46.595253 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [req-52557b49-8098-4d51-8b7b-52448b5f1d6f req-466f4396-c83c-4325-b570-96f731557e6a service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:44:46.606736 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.compute.server_external_events [req-52557b49-8098-4d51-8b7b-52448b5f1d6f req-466f4396-c83c-4325-b570-96f731557e6a service nova] Creating event network-changed:8871fbf1-bd05-439a-8a3c-b5bf4f3ec481 for instance c9a9e592-2c6c-41df-ae1b-2343a744a5c0 on hv-cinder-84614 Jun 30 12:44:46.612819 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [req-52557b49-8098-4d51-8b7b-52448b5f1d6f req-466f4396-c83c-4325-b570-96f731557e6a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032953 Jun 30 12:44:46.613414 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 536/1077] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 30 12:44:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:44:47.419528 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-14f90a28-879b-47db-8731-c5540c0ca5a0 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:44:47.420175 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-14f90a28-879b-47db-8731-c5540c0ca5a0 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] [instance: c9a9e592-2c6c-41df-ae1b-2343a744a5c0] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:44:47.427102 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-14f90a28-879b-47db-8731-c5540c0ca5a0 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:44:47.427572 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-14f90a28-879b-47db-8731-c5540c0ca5a0 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:44:47.428340 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-14f90a28-879b-47db-8731-c5540c0ca5a0 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:44:47.428808 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-14f90a28-879b-47db-8731-c5540c0ca5a0 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:44:47.564435 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-14f90a28-879b-47db-8731-c5540c0ca5a0 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b952a9d6bad40c4b2829256bed0e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ebc78f23044b98a13e5e3ebc5dd614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:44:47.572135 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-14f90a28-879b-47db-8731-c5540c0ca5a0 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] 10.222.0.57 "GET /compute/v2.1/servers/c9a9e592-2c6c-41df-ae1b-2343a744a5c0" status: 200 len: 1314 microversion: 2.1 time: 0.156540 Jun 30 12:44:47.572869 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 542/1078] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:44:47 2022] GET /compute/v2.1/servers/c9a9e592-2c6c-41df-ae1b-2343a744a5c0 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:44:47.696820 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 12:44:47.697054 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Thu Jun 30 12:44:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 12:44:48.591159 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-89fc2a6c-4586-4097-9342-ba51e429aebf tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:44:48.592000 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-89fc2a6c-4586-4097-9342-ba51e429aebf tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] [instance: c9a9e592-2c6c-41df-ae1b-2343a744a5c0] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:44:48.599147 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-89fc2a6c-4586-4097-9342-ba51e429aebf tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:44:48.599351 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-89fc2a6c-4586-4097-9342-ba51e429aebf tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:44:48.600113 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-89fc2a6c-4586-4097-9342-ba51e429aebf tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:44:48.600686 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-89fc2a6c-4586-4097-9342-ba51e429aebf tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:44:48.770200 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-89fc2a6c-4586-4097-9342-ba51e429aebf tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b952a9d6bad40c4b2829256bed0e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ebc78f23044b98a13e5e3ebc5dd614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:44:48.780676 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-89fc2a6c-4586-4097-9342-ba51e429aebf tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] 10.222.0.57 "GET /compute/v2.1/servers/c9a9e592-2c6c-41df-ae1b-2343a744a5c0" status: 200 len: 1314 microversion: 2.1 time: 0.194092 Jun 30 12:44:48.781671 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 537/1079] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:44:48 2022] GET /compute/v2.1/servers/c9a9e592-2c6c-41df-ae1b-2343a744a5c0 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:44:49.798121 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-019bccd9-5bbd-4bf8-af1d-fbd841786e56 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:44:49.798980 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-019bccd9-5bbd-4bf8-af1d-fbd841786e56 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] [instance: c9a9e592-2c6c-41df-ae1b-2343a744a5c0] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:44:49.805556 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-019bccd9-5bbd-4bf8-af1d-fbd841786e56 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:44:49.806006 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-019bccd9-5bbd-4bf8-af1d-fbd841786e56 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:44:49.806774 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-019bccd9-5bbd-4bf8-af1d-fbd841786e56 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:44:49.807211 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-019bccd9-5bbd-4bf8-af1d-fbd841786e56 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:44:49.940417 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-019bccd9-5bbd-4bf8-af1d-fbd841786e56 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b952a9d6bad40c4b2829256bed0e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ebc78f23044b98a13e5e3ebc5dd614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:44:49.948901 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-019bccd9-5bbd-4bf8-af1d-fbd841786e56 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] 10.222.0.57 "GET /compute/v2.1/servers/c9a9e592-2c6c-41df-ae1b-2343a744a5c0" status: 200 len: 1314 microversion: 2.1 time: 0.154025 Jun 30 12:44:49.948901 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 543/1080] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:44:49 2022] GET /compute/v2.1/servers/c9a9e592-2c6c-41df-ae1b-2343a744a5c0 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:44:50.964941 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-b6b057c8-be4d-42ed-ad82-85ee1a2f88a5 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:44:50.965541 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-b6b057c8-be4d-42ed-ad82-85ee1a2f88a5 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] [instance: c9a9e592-2c6c-41df-ae1b-2343a744a5c0] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:44:50.972204 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-b6b057c8-be4d-42ed-ad82-85ee1a2f88a5 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:44:50.972669 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-b6b057c8-be4d-42ed-ad82-85ee1a2f88a5 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:44:50.973449 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-b6b057c8-be4d-42ed-ad82-85ee1a2f88a5 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:44:50.973880 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-b6b057c8-be4d-42ed-ad82-85ee1a2f88a5 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:44:51.120048 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-b6b057c8-be4d-42ed-ad82-85ee1a2f88a5 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b952a9d6bad40c4b2829256bed0e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ebc78f23044b98a13e5e3ebc5dd614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:44:51.128483 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-b6b057c8-be4d-42ed-ad82-85ee1a2f88a5 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] 10.222.0.57 "GET /compute/v2.1/servers/c9a9e592-2c6c-41df-ae1b-2343a744a5c0" status: 200 len: 1314 microversion: 2.1 time: 0.167508 Jun 30 12:44:51.129093 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 538/1081] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:44:50 2022] GET /compute/v2.1/servers/c9a9e592-2c6c-41df-ae1b-2343a744a5c0 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:44:52.144990 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-151191a7-0800-42ed-96fc-e61891133414 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:44:52.145600 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-151191a7-0800-42ed-96fc-e61891133414 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] [instance: c9a9e592-2c6c-41df-ae1b-2343a744a5c0] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:44:52.152518 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-151191a7-0800-42ed-96fc-e61891133414 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:44:52.153064 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-151191a7-0800-42ed-96fc-e61891133414 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:44:52.153823 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-151191a7-0800-42ed-96fc-e61891133414 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:44:52.154258 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-151191a7-0800-42ed-96fc-e61891133414 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:44:52.294998 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-151191a7-0800-42ed-96fc-e61891133414 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b952a9d6bad40c4b2829256bed0e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ebc78f23044b98a13e5e3ebc5dd614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:44:52.303553 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-151191a7-0800-42ed-96fc-e61891133414 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] 10.222.0.57 "GET /compute/v2.1/servers/c9a9e592-2c6c-41df-ae1b-2343a744a5c0" status: 200 len: 1314 microversion: 2.1 time: 0.162440 Jun 30 12:44:52.304186 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 544/1082] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:44:52 2022] GET /compute/v2.1/servers/c9a9e592-2c6c-41df-ae1b-2343a744a5c0 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:44:52.405136 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [req-d1390f2a-51e7-442e-a434-4b839edc4611 req-49cdd903-6972-4da9-83e3-bec5a0a31d0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9a9e592-2c6c-41df-ae1b-2343a744a5c0", "name": "network-vif-plugged", "status": "completed", "tag": "8871fbf1-bd05-439a-8a3c-b5bf4f3ec481"}]} {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:44:52.413428 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [req-d1390f2a-51e7-442e-a434-4b839edc4611 req-49cdd903-6972-4da9-83e3-bec5a0a31d0f service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:44:52.413870 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [req-d1390f2a-51e7-442e-a434-4b839edc4611 req-49cdd903-6972-4da9-83e3-bec5a0a31d0f service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:44:52.424983 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.compute.server_external_events [req-d1390f2a-51e7-442e-a434-4b839edc4611 req-49cdd903-6972-4da9-83e3-bec5a0a31d0f service nova] Creating event network-vif-plugged:8871fbf1-bd05-439a-8a3c-b5bf4f3ec481 for instance c9a9e592-2c6c-41df-ae1b-2343a744a5c0 on hv-cinder-84614 Jun 30 12:44:52.430019 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [req-d1390f2a-51e7-442e-a434-4b839edc4611 req-49cdd903-6972-4da9-83e3-bec5a0a31d0f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.179286 Jun 30 12:44:52.430586 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 539/1083] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 30 12:44:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 12:44:53.325434 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-b6be73a2-17fd-4052-a125-2b67bf59853c tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:44:53.326323 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-b6be73a2-17fd-4052-a125-2b67bf59853c tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] [instance: c9a9e592-2c6c-41df-ae1b-2343a744a5c0] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:44:53.338318 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-b6be73a2-17fd-4052-a125-2b67bf59853c tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:44:53.339051 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-b6be73a2-17fd-4052-a125-2b67bf59853c tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:44:53.340298 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-b6be73a2-17fd-4052-a125-2b67bf59853c tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:44:53.341054 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-b6be73a2-17fd-4052-a125-2b67bf59853c tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:44:53.475053 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-b6be73a2-17fd-4052-a125-2b67bf59853c tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b952a9d6bad40c4b2829256bed0e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ebc78f23044b98a13e5e3ebc5dd614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:44:53.487225 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-b6be73a2-17fd-4052-a125-2b67bf59853c tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] 10.222.0.57 "GET /compute/v2.1/servers/c9a9e592-2c6c-41df-ae1b-2343a744a5c0" status: 200 len: 1314 microversion: 2.1 time: 0.168137 Jun 30 12:44:53.488024 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 545/1084] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:44:53 2022] GET /compute/v2.1/servers/c9a9e592-2c6c-41df-ae1b-2343a744a5c0 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:44:54.501482 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG dbcounter [-] [124298] Writing DB stats nova_cell0:SELECT=2 {{(pid=124298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:44:54.502347 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG dbcounter [-] [124298] Writing DB stats nova_cell0:SELECT=6 {{(pid=124298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:44:54.506755 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-d794412e-871c-4ae2-b42b-307670514385 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:44:54.507611 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-d794412e-871c-4ae2-b42b-307670514385 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] [instance: c9a9e592-2c6c-41df-ae1b-2343a744a5c0] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:44:54.514894 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-d794412e-871c-4ae2-b42b-307670514385 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:44:54.515342 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-d794412e-871c-4ae2-b42b-307670514385 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:44:54.516109 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-d794412e-871c-4ae2-b42b-307670514385 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:44:54.516538 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-d794412e-871c-4ae2-b42b-307670514385 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:44:54.661334 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-d794412e-871c-4ae2-b42b-307670514385 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b952a9d6bad40c4b2829256bed0e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ebc78f23044b98a13e5e3ebc5dd614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:44:54.668770 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-d794412e-871c-4ae2-b42b-307670514385 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] 10.222.0.57 "GET /compute/v2.1/servers/c9a9e592-2c6c-41df-ae1b-2343a744a5c0" status: 200 len: 1496 microversion: 2.1 time: 0.168917 Jun 30 12:44:54.669358 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 540/1085] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:44:54 2022] GET /compute/v2.1/servers/c9a9e592-2c6c-41df-ae1b-2343a744a5c0 => generated 1496 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:44:55.157124 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-cc7c4717-e421-4992-82ba-3ded48502019 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:44:55.157695 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-cc7c4717-e421-4992-82ba-3ded48502019 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] [instance: c9a9e592-2c6c-41df-ae1b-2343a744a5c0] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:44:55.160011 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG dbcounter [-] [124297] Writing DB stats nova_cell0:SELECT=2 {{(pid=124297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:44:55.166123 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-cc7c4717-e421-4992-82ba-3ded48502019 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:44:55.166681 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-cc7c4717-e421-4992-82ba-3ded48502019 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:44:55.167527 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-cc7c4717-e421-4992-82ba-3ded48502019 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:44:55.168054 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-cc7c4717-e421-4992-82ba-3ded48502019 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:44:55.194377 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-cc7c4717-e421-4992-82ba-3ded48502019 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] [instance: c9a9e592-2c6c-41df-ae1b-2343a744a5c0] Going to try to terminate instance {{(pid=124297) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 12:44:55.299799 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-cc7c4717-e421-4992-82ba-3ded48502019 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] 10.222.0.57 "DELETE /compute/v2.1/servers/c9a9e592-2c6c-41df-ae1b-2343a744a5c0" status: 204 len: 0 microversion: 2.1 time: 0.146406 Jun 30 12:44:55.300392 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 546/1086] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 30 12:44:55 2022] DELETE /compute/v2.1/servers/c9a9e592-2c6c-41df-ae1b-2343a744a5c0 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 12:44:55.309530 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-4388c430-c199-4dc0-be12-620ddb7b0fb6 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:44:55.310144 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-4388c430-c199-4dc0-be12-620ddb7b0fb6 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] [instance: c9a9e592-2c6c-41df-ae1b-2343a744a5c0] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:44:55.316158 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-4388c430-c199-4dc0-be12-620ddb7b0fb6 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:44:55.316839 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-4388c430-c199-4dc0-be12-620ddb7b0fb6 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:44:55.317771 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-4388c430-c199-4dc0-be12-620ddb7b0fb6 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:44:55.318374 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-4388c430-c199-4dc0-be12-620ddb7b0fb6 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:44:55.454673 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-4388c430-c199-4dc0-be12-620ddb7b0fb6 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b952a9d6bad40c4b2829256bed0e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ebc78f23044b98a13e5e3ebc5dd614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:44:55.463619 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-4388c430-c199-4dc0-be12-620ddb7b0fb6 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] 10.222.0.57 "GET /compute/v2.1/servers/c9a9e592-2c6c-41df-ae1b-2343a744a5c0" status: 200 len: 1502 microversion: 2.1 time: 0.158120 Jun 30 12:44:55.464422 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 541/1087] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:44:55 2022] GET /compute/v2.1/servers/c9a9e592-2c6c-41df-ae1b-2343a744a5c0 => generated 1502 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 12:44:56.482230 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-b7631395-5050-453a-9bda-4014bc809cc1 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:44:56.482931 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-b7631395-5050-453a-9bda-4014bc809cc1 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] [instance: c9a9e592-2c6c-41df-ae1b-2343a744a5c0] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:44:56.490625 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-b7631395-5050-453a-9bda-4014bc809cc1 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:44:56.491065 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-b7631395-5050-453a-9bda-4014bc809cc1 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:44:56.491877 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-b7631395-5050-453a-9bda-4014bc809cc1 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:44:56.492313 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-b7631395-5050-453a-9bda-4014bc809cc1 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:44:56.630447 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-b7631395-5050-453a-9bda-4014bc809cc1 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b952a9d6bad40c4b2829256bed0e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ebc78f23044b98a13e5e3ebc5dd614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:44:56.638277 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-b7631395-5050-453a-9bda-4014bc809cc1 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] 10.222.0.57 "GET /compute/v2.1/servers/c9a9e592-2c6c-41df-ae1b-2343a744a5c0" status: 200 len: 1502 microversion: 2.1 time: 0.160540 Jun 30 12:44:56.638848 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 547/1088] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:44:56 2022] GET /compute/v2.1/servers/c9a9e592-2c6c-41df-ae1b-2343a744a5c0 => generated 1502 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:44:57.235633 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [req-95055a96-3b97-4675-aea9-a03076cc57ae req-94ae5450-473d-46fc-8d2c-28a7aac33625 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9a9e592-2c6c-41df-ae1b-2343a744a5c0", "name": "network-vif-deleted", "tag": "8871fbf1-bd05-439a-8a3c-b5bf4f3ec481"}]} {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:44:57.246045 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [req-95055a96-3b97-4675-aea9-a03076cc57ae req-94ae5450-473d-46fc-8d2c-28a7aac33625 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:44:57.246652 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [req-95055a96-3b97-4675-aea9-a03076cc57ae req-94ae5450-473d-46fc-8d2c-28a7aac33625 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:44:57.260237 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.compute.server_external_events [req-95055a96-3b97-4675-aea9-a03076cc57ae req-94ae5450-473d-46fc-8d2c-28a7aac33625 service nova] Creating event network-vif-deleted:8871fbf1-bd05-439a-8a3c-b5bf4f3ec481 for instance c9a9e592-2c6c-41df-ae1b-2343a744a5c0 on hv-cinder-84614 Jun 30 12:44:57.265966 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [req-95055a96-3b97-4675-aea9-a03076cc57ae req-94ae5450-473d-46fc-8d2c-28a7aac33625 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035343 Jun 30 12:44:57.266543 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 542/1089] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 30 12:44:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:44:57.655590 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-766f2488-e719-4c9b-9a90-f8ccf6f59526 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:44:57.656242 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-766f2488-e719-4c9b-9a90-f8ccf6f59526 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] [instance: c9a9e592-2c6c-41df-ae1b-2343a744a5c0] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:44:57.663244 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-766f2488-e719-4c9b-9a90-f8ccf6f59526 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:44:57.663741 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-766f2488-e719-4c9b-9a90-f8ccf6f59526 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:44:57.664756 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-766f2488-e719-4c9b-9a90-f8ccf6f59526 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:44:57.665214 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-766f2488-e719-4c9b-9a90-f8ccf6f59526 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:44:57.699318 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-766f2488-e719-4c9b-9a90-f8ccf6f59526 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:44:57.699804 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-766f2488-e719-4c9b-9a90-f8ccf6f59526 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:44:57.700248 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.objects.instance [None req-766f2488-e719-4c9b-9a90-f8ccf6f59526 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lazy-loading 'fault' on Instance uuid c9a9e592-2c6c-41df-ae1b-2343a744a5c0 {{(pid=124297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 12:44:57.743979 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-766f2488-e719-4c9b-9a90-f8ccf6f59526 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b952a9d6bad40c4b2829256bed0e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ebc78f23044b98a13e5e3ebc5dd614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:44:57.752541 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-766f2488-e719-4c9b-9a90-f8ccf6f59526 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] 10.222.0.57 "GET /compute/v2.1/servers/c9a9e592-2c6c-41df-ae1b-2343a744a5c0" status: 200 len: 1304 microversion: 2.1 time: 0.100911 Jun 30 12:44:57.753140 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 548/1090] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:44:57 2022] GET /compute/v2.1/servers/c9a9e592-2c6c-41df-ae1b-2343a744a5c0 => generated 1304 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:44:58.774469 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-058f4e70-84ec-4b23-9c1b-efa4fac2b8bd tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:44:58.775460 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-058f4e70-84ec-4b23-9c1b-efa4fac2b8bd tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] [instance: c9a9e592-2c6c-41df-ae1b-2343a744a5c0] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:44:58.783755 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-058f4e70-84ec-4b23-9c1b-efa4fac2b8bd tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:44:58.784202 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-058f4e70-84ec-4b23-9c1b-efa4fac2b8bd tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:44:58.785000 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-058f4e70-84ec-4b23-9c1b-efa4fac2b8bd tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:44:58.785430 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-058f4e70-84ec-4b23-9c1b-efa4fac2b8bd tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:44:58.798875 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.wsgi [None req-058f4e70-84ec-4b23-9c1b-efa4fac2b8bd tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] HTTP exception thrown: Instance c9a9e592-2c6c-41df-ae1b-2343a744a5c0 could not be found. Jun 30 12:44:58.800487 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-058f4e70-84ec-4b23-9c1b-efa4fac2b8bd tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Request method failure captured: Jun 30 12:44:58.800487 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: request: GET /compute/v2.1/servers/c9a9e592-2c6c-41df-ae1b-2343a744a5c0 HTTP/1.1 Jun 30 12:44:58.800487 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Accept: application/json Jun 30 12:44:58.800487 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Accept-Encoding: identity Jun 30 12:44:58.800487 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Connection: close Jun 30 12:44:58.800487 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Content-Length: 0 Jun 30 12:44:58.800487 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Content-Type: application/json Jun 30 12:44:58.800487 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Host: 10.222.0.57 Jun 30 12:44:58.800487 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Openstack-System-Scope: None Jun 30 12:44:58.800487 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: User-Agent: python-urllib3/1.26.9 Jun 30 12:44:58.800487 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Auth-Token: gAAAAABivZq5fe03G8DKrrqtw1aO0N-LlURcIN6rj20bs9iMNCkqlRV3Mgc0mkww0dOGUsvqsI2RJikM9raKN0Rz3jAQ_3Jm17m8W9lb_clCjttms8NB6t67aZPMAAJdgRTxYrO7rftEqydIxgxzrQTQQC5L10HQCYRahkB2XahHF5x4pelzcFQ Jun 30 12:44:58.800487 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Domain-Id: None Jun 30 12:44:58.800487 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Domain-Name: None Jun 30 12:44:58.800487 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Identity-Status: Confirmed Jun 30 12:44:58.800487 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Is-Admin-Project: True Jun 30 12:44:58.800487 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Domain-Id: default Jun 30 12:44:58.800487 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Domain-Name: Default Jun 30 12:44:58.800487 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Id: b9ebc78f23044b98a13e5e3ebc5dd614 Jun 30 12:44:58.800487 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Name: tempest-VolumesActionsTest-593780940 Jun 30 12:44:58.800487 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Role: member,reader Jun 30 12:44:58.800487 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Roles: member,reader Jun 30 12:44:58.802161 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/b9ebc78f23044b98a13e5e3ebc5dd614"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b9ebc78f23044b98a13e5e3ebc5dd614"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_b9ebc78f23044b98a13e5e3ebc5dd614", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b9ebc78f23044b98a13e5e3ebc5dd614"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 30 12:44:58.802161 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant: tempest-VolumesActionsTest-593780940 Jun 30 12:44:58.802161 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant-Id: b9ebc78f23044b98a13e5e3ebc5dd614 Jun 30 12:44:58.802161 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant-Name: tempest-VolumesActionsTest-593780940 Jun 30 12:44:58.802161 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User: tempest-VolumesActionsTest-593780940-project Jun 30 12:44:58.802161 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Domain-Id: default Jun 30 12:44:58.802161 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Domain-Name: Default Jun 30 12:44:58.802161 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Id: 6b952a9d6bad40c4b2829256bed0e017 Jun 30 12:44:58.802161 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Name: tempest-VolumesActionsTest-593780940-project Jun 30 12:44:58.802161 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: method: > Jun 30 12:44:58.802161 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: exception: Instance c9a9e592-2c6c-41df-ae1b-2343a744a5c0 could not be found. Jun 30 12:44:58.802161 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: action_args: {'id': 'c9a9e592-2c6c-41df-ae1b-2343a744a5c0'} Jun 30 12:44:58.803196 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 12:44:58.803196 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:44:58.803196 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 12:44:58.803196 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 12:44:58.803196 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 12:44:58.803196 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 12:44:58.803196 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 12:44:58.803196 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 12:44:58.803196 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 12:44:58.803196 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 12:44:58.803196 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9a9e592-2c6c-41df-ae1b-2343a744a5c0 could not be found. Jun 30 12:44:58.803196 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:44:58.803196 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:44:58.803196 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:44:58.803196 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:44:58.803196 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:44:58.803196 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:44:58.803196 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 12:44:58.803196 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 12:44:58.803196 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 12:44:58.804782 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 12:44:58.804782 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 12:44:58.804782 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 12:44:58.804782 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 12:44:58.804782 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 12:44:58.804782 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 12:44:58.804782 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 12:44:58.804782 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9a9e592-2c6c-41df-ae1b-2343a744a5c0 could not be found. Jun 30 12:44:58.804782 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:44:58.804782 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:44:58.804782 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:44:58.804782 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:44:58.804782 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:44:58.804782 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:44:58.804782 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 12:44:58.804782 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 12:44:58.804782 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9a9e592-2c6c-41df-ae1b-2343a744a5c0 could not be found. Jun 30 12:44:58.804782 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:44:58.806203 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-058f4e70-84ec-4b23-9c1b-efa4fac2b8bd tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Returning 404 to user: Instance c9a9e592-2c6c-41df-ae1b-2343a744a5c0 could not be found. {{(pid=124298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 12:44:58.806203 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-058f4e70-84ec-4b23-9c1b-efa4fac2b8bd tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] 10.222.0.57 "GET /compute/v2.1/servers/c9a9e592-2c6c-41df-ae1b-2343a744a5c0" status: 404 len: 111 microversion: 2.1 time: 0.034767 Jun 30 12:44:58.809613 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 543/1091] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:44:58 2022] GET /compute/v2.1/servers/c9a9e592-2c6c-41df-ae1b-2343a744a5c0 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 12:44:58.900324 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-dbc79cfa-ab5e-4474-8d54-3da97038b85e tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1923233820", "imageRef": "776a1662-a241-4e20-9a9c-e4743c64efd0", "flavorRef": "452", "networks": [{"uuid": "17b86a73-5b74-4e4c-b0f6-b1b2a3e377c3"}]}} {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:44:58.956578 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.network.neutron [None req-dbc79cfa-ab5e-4474-8d54-3da97038b85e tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] validate_networks() for [('17b86a73-5b74-4e4c-b0f6-b1b2a3e377c3', None, None, None, None, None)] {{(pid=124297) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 12:44:59.424920 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.virt.hardware [None req-dbc79cfa-ab5e-4474-8d54-3da97038b85e tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Flavor limits 0:0:0 {{(pid=124297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 12:44:59.425474 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.virt.hardware [None req-dbc79cfa-ab5e-4474-8d54-3da97038b85e tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Image limits 0:0:0 {{(pid=124297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 12:44:59.425949 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.virt.hardware [None req-dbc79cfa-ab5e-4474-8d54-3da97038b85e tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Flavor pref 0:0:0 {{(pid=124297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 12:44:59.426349 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.virt.hardware [None req-dbc79cfa-ab5e-4474-8d54-3da97038b85e tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Image pref 0:0:0 {{(pid=124297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 12:44:59.426751 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.virt.hardware [None req-dbc79cfa-ab5e-4474-8d54-3da97038b85e tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 12:44:59.435630 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-dbc79cfa-ab5e-4474-8d54-3da97038b85e tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:44:59.436072 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-dbc79cfa-ab5e-4474-8d54-3da97038b85e tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:44:59.436897 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-dbc79cfa-ab5e-4474-8d54-3da97038b85e tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:44:59.437428 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-dbc79cfa-ab5e-4474-8d54-3da97038b85e tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:44:59.454980 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.quota [None req-dbc79cfa-ab5e-4474-8d54-3da97038b85e tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Getting quotas for project b9ebc78f23044b98a13e5e3ebc5dd614. Resources: {'cores', 'ram', 'instances'} {{(pid=124297) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 12:44:59.458812 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.quota [None req-dbc79cfa-ab5e-4474-8d54-3da97038b85e tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Getting quotas for user 6b952a9d6bad40c4b2829256bed0e017 and project b9ebc78f23044b98a13e5e3ebc5dd614. Resources: {'cores', 'ram', 'instances'} {{(pid=124297) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 12:44:59.474696 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-dbc79cfa-ab5e-4474-8d54-3da97038b85e tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Going to run 1 instances... {{(pid=124297) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 12:44:59.477220 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-dbc79cfa-ab5e-4474-8d54-3da97038b85e tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] [instance: d4df4fe8-238b-4558-bb0b-b1635a3eedb5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='776a1662-a241-4e20-9a9c-e4743c64efd0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124297) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 12:44:59.525345 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-dbc79cfa-ab5e-4474-8d54-3da97038b85e tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.629174 Jun 30 12:44:59.526010 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 549/1092] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 30 12:44:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 631 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 12:44:59.537592 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-b0b08460-5223-4dfa-9995-af43a9eeaa6b tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:44:59.538195 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-b0b08460-5223-4dfa-9995-af43a9eeaa6b tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] [instance: d4df4fe8-238b-4558-bb0b-b1635a3eedb5] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:44:59.595577 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-b0b08460-5223-4dfa-9995-af43a9eeaa6b tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b952a9d6bad40c4b2829256bed0e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ebc78f23044b98a13e5e3ebc5dd614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:44:59.602915 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-b0b08460-5223-4dfa-9995-af43a9eeaa6b tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] 10.222.0.57 "GET /compute/v2.1/servers/d4df4fe8-238b-4558-bb0b-b1635a3eedb5" status: 200 len: 1214 microversion: 2.1 time: 0.069562 Jun 30 12:44:59.603485 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 544/1093] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:44:59 2022] GET /compute/v2.1/servers/d4df4fe8-238b-4558-bb0b-b1635a3eedb5 => generated 1214 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:45:00.620867 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-b5a7f88b-d660-4f70-aab7-5f9e94f5fcc8 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:45:00.621812 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-b5a7f88b-d660-4f70-aab7-5f9e94f5fcc8 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] [instance: d4df4fe8-238b-4558-bb0b-b1635a3eedb5] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:45:00.629714 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-b5a7f88b-d660-4f70-aab7-5f9e94f5fcc8 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:45:00.630299 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-b5a7f88b-d660-4f70-aab7-5f9e94f5fcc8 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:45:00.631286 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-b5a7f88b-d660-4f70-aab7-5f9e94f5fcc8 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:45:00.631812 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-b5a7f88b-d660-4f70-aab7-5f9e94f5fcc8 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:45:00.710326 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-b5a7f88b-d660-4f70-aab7-5f9e94f5fcc8 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b952a9d6bad40c4b2829256bed0e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ebc78f23044b98a13e5e3ebc5dd614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:45:00.718403 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-b5a7f88b-d660-4f70-aab7-5f9e94f5fcc8 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] 10.222.0.57 "GET /compute/v2.1/servers/d4df4fe8-238b-4558-bb0b-b1635a3eedb5" status: 200 len: 1284 microversion: 2.1 time: 0.101695 Jun 30 12:45:00.719256 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 550/1094] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:45:00 2022] GET /compute/v2.1/servers/d4df4fe8-238b-4558-bb0b-b1635a3eedb5 => generated 1284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:45:01.736857 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-84eeb2c1-ad91-4d9d-b825-72b65376a7ff tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:45:01.737481 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-84eeb2c1-ad91-4d9d-b825-72b65376a7ff tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] [instance: d4df4fe8-238b-4558-bb0b-b1635a3eedb5] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:45:01.755375 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-84eeb2c1-ad91-4d9d-b825-72b65376a7ff tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:45:01.755715 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-84eeb2c1-ad91-4d9d-b825-72b65376a7ff tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:45:01.756476 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-84eeb2c1-ad91-4d9d-b825-72b65376a7ff tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:45:01.765995 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-84eeb2c1-ad91-4d9d-b825-72b65376a7ff tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:45:01.877893 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [req-aeb1105c-15b7-4bef-bdf3-0d2927ba7d5f req-90433759-a21c-4894-adac-f1dcf91c945b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4df4fe8-238b-4558-bb0b-b1635a3eedb5", "tag": "39fd4680-7535-4ad6-8535-3453265bbd86"}]} {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:45:01.886835 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [req-aeb1105c-15b7-4bef-bdf3-0d2927ba7d5f req-90433759-a21c-4894-adac-f1dcf91c945b service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:45:01.887547 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [req-aeb1105c-15b7-4bef-bdf3-0d2927ba7d5f req-90433759-a21c-4894-adac-f1dcf91c945b service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:45:01.918442 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.compute.server_external_events [req-aeb1105c-15b7-4bef-bdf3-0d2927ba7d5f req-90433759-a21c-4894-adac-f1dcf91c945b service nova] Creating event network-changed:39fd4680-7535-4ad6-8535-3453265bbd86 for instance d4df4fe8-238b-4558-bb0b-b1635a3eedb5 on hv-cinder-84614 Jun 30 12:45:01.923891 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [req-aeb1105c-15b7-4bef-bdf3-0d2927ba7d5f req-90433759-a21c-4894-adac-f1dcf91c945b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050873 Jun 30 12:45:01.924499 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 551/1095] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 30 12:45:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:45:02.008265 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-84eeb2c1-ad91-4d9d-b825-72b65376a7ff tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b952a9d6bad40c4b2829256bed0e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ebc78f23044b98a13e5e3ebc5dd614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:45:02.017182 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-84eeb2c1-ad91-4d9d-b825-72b65376a7ff tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] 10.222.0.57 "GET /compute/v2.1/servers/d4df4fe8-238b-4558-bb0b-b1635a3eedb5" status: 200 len: 1314 microversion: 2.1 time: 0.284983 Jun 30 12:45:02.021291 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 545/1096] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:45:01 2022] GET /compute/v2.1/servers/d4df4fe8-238b-4558-bb0b-b1635a3eedb5 => generated 1314 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:45:03.039697 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-b44f1685-b816-4760-ac63-f7bbeac69c1c tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:45:03.040559 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-b44f1685-b816-4760-ac63-f7bbeac69c1c tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] [instance: d4df4fe8-238b-4558-bb0b-b1635a3eedb5] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:45:03.048617 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-b44f1685-b816-4760-ac63-f7bbeac69c1c tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:45:03.049083 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-b44f1685-b816-4760-ac63-f7bbeac69c1c tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:45:03.049924 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-b44f1685-b816-4760-ac63-f7bbeac69c1c tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:45:03.050359 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-b44f1685-b816-4760-ac63-f7bbeac69c1c tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:45:03.192552 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-b44f1685-b816-4760-ac63-f7bbeac69c1c tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b952a9d6bad40c4b2829256bed0e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ebc78f23044b98a13e5e3ebc5dd614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:45:03.200516 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-b44f1685-b816-4760-ac63-f7bbeac69c1c tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] 10.222.0.57 "GET /compute/v2.1/servers/d4df4fe8-238b-4558-bb0b-b1635a3eedb5" status: 200 len: 1314 microversion: 2.1 time: 0.165675 Jun 30 12:45:03.201119 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 552/1097] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:45:03 2022] GET /compute/v2.1/servers/d4df4fe8-238b-4558-bb0b-b1635a3eedb5 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:45:04.218005 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-f516aae2-1e44-4b39-84d1-782d55a39a44 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:45:04.218631 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-f516aae2-1e44-4b39-84d1-782d55a39a44 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] [instance: d4df4fe8-238b-4558-bb0b-b1635a3eedb5] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:45:04.225786 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-f516aae2-1e44-4b39-84d1-782d55a39a44 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:45:04.226242 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-f516aae2-1e44-4b39-84d1-782d55a39a44 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:45:04.227004 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-f516aae2-1e44-4b39-84d1-782d55a39a44 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:45:04.227434 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-f516aae2-1e44-4b39-84d1-782d55a39a44 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:45:04.359456 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-f516aae2-1e44-4b39-84d1-782d55a39a44 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b952a9d6bad40c4b2829256bed0e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ebc78f23044b98a13e5e3ebc5dd614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:45:04.371332 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-f516aae2-1e44-4b39-84d1-782d55a39a44 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] 10.222.0.57 "GET /compute/v2.1/servers/d4df4fe8-238b-4558-bb0b-b1635a3eedb5" status: 200 len: 1314 microversion: 2.1 time: 0.157224 Jun 30 12:45:04.371867 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 546/1098] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:45:04 2022] GET /compute/v2.1/servers/d4df4fe8-238b-4558-bb0b-b1635a3eedb5 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:45:05.392091 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-07d9c3ab-8780-4459-bd01-28c76354bb5b tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:45:05.393130 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-07d9c3ab-8780-4459-bd01-28c76354bb5b tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] [instance: d4df4fe8-238b-4558-bb0b-b1635a3eedb5] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:45:05.404702 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-07d9c3ab-8780-4459-bd01-28c76354bb5b tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:45:05.405480 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-07d9c3ab-8780-4459-bd01-28c76354bb5b tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:45:05.406732 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-07d9c3ab-8780-4459-bd01-28c76354bb5b tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:45:05.407957 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-07d9c3ab-8780-4459-bd01-28c76354bb5b tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:45:05.543517 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-07d9c3ab-8780-4459-bd01-28c76354bb5b tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b952a9d6bad40c4b2829256bed0e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ebc78f23044b98a13e5e3ebc5dd614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:45:05.553233 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-07d9c3ab-8780-4459-bd01-28c76354bb5b tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] 10.222.0.57 "GET /compute/v2.1/servers/d4df4fe8-238b-4558-bb0b-b1635a3eedb5" status: 200 len: 1314 microversion: 2.1 time: 0.167808 Jun 30 12:45:05.553806 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 553/1099] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:45:05 2022] GET /compute/v2.1/servers/d4df4fe8-238b-4558-bb0b-b1635a3eedb5 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:45:06.575616 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-854a8910-3e3b-420c-a9dd-91d7e0094ff1 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:45:06.576679 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-854a8910-3e3b-420c-a9dd-91d7e0094ff1 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] [instance: d4df4fe8-238b-4558-bb0b-b1635a3eedb5] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:45:06.584923 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-854a8910-3e3b-420c-a9dd-91d7e0094ff1 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:45:06.585374 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-854a8910-3e3b-420c-a9dd-91d7e0094ff1 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:45:06.586153 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-854a8910-3e3b-420c-a9dd-91d7e0094ff1 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:45:06.586588 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-854a8910-3e3b-420c-a9dd-91d7e0094ff1 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:45:06.729257 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-854a8910-3e3b-420c-a9dd-91d7e0094ff1 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b952a9d6bad40c4b2829256bed0e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ebc78f23044b98a13e5e3ebc5dd614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:45:06.737205 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-854a8910-3e3b-420c-a9dd-91d7e0094ff1 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] 10.222.0.57 "GET /compute/v2.1/servers/d4df4fe8-238b-4558-bb0b-b1635a3eedb5" status: 200 len: 1314 microversion: 2.1 time: 0.169379 Jun 30 12:45:06.737739 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 547/1100] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:45:06 2022] GET /compute/v2.1/servers/d4df4fe8-238b-4558-bb0b-b1635a3eedb5 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:45:07.757732 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-de52ec68-52e5-479c-8c9d-55a573d31305 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:45:07.758482 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-de52ec68-52e5-479c-8c9d-55a573d31305 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] [instance: d4df4fe8-238b-4558-bb0b-b1635a3eedb5] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:45:07.767543 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-de52ec68-52e5-479c-8c9d-55a573d31305 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:45:07.768102 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-de52ec68-52e5-479c-8c9d-55a573d31305 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:45:07.769106 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-de52ec68-52e5-479c-8c9d-55a573d31305 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:45:07.769644 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-de52ec68-52e5-479c-8c9d-55a573d31305 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:45:07.913020 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-de52ec68-52e5-479c-8c9d-55a573d31305 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b952a9d6bad40c4b2829256bed0e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ebc78f23044b98a13e5e3ebc5dd614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:45:07.924105 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-de52ec68-52e5-479c-8c9d-55a573d31305 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] 10.222.0.57 "GET /compute/v2.1/servers/d4df4fe8-238b-4558-bb0b-b1635a3eedb5" status: 200 len: 1314 microversion: 2.1 time: 0.171347 Jun 30 12:45:07.924683 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 554/1101] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:45:07 2022] GET /compute/v2.1/servers/d4df4fe8-238b-4558-bb0b-b1635a3eedb5 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:45:08.414574 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [req-a8e43153-4470-468b-8087-f96cdb829bdc req-2087a753-30f1-4199-9e42-6ed9dfbbb945 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4df4fe8-238b-4558-bb0b-b1635a3eedb5", "name": "network-vif-plugged", "status": "completed", "tag": "39fd4680-7535-4ad6-8535-3453265bbd86"}]} {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:45:08.423753 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [req-a8e43153-4470-468b-8087-f96cdb829bdc req-2087a753-30f1-4199-9e42-6ed9dfbbb945 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:45:08.424323 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [req-a8e43153-4470-468b-8087-f96cdb829bdc req-2087a753-30f1-4199-9e42-6ed9dfbbb945 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:45:08.435868 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.compute.server_external_events [req-a8e43153-4470-468b-8087-f96cdb829bdc req-2087a753-30f1-4199-9e42-6ed9dfbbb945 service nova] Creating event network-vif-plugged:39fd4680-7535-4ad6-8535-3453265bbd86 for instance d4df4fe8-238b-4558-bb0b-b1635a3eedb5 on hv-cinder-84614 Jun 30 12:45:08.441112 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [req-a8e43153-4470-468b-8087-f96cdb829bdc req-2087a753-30f1-4199-9e42-6ed9dfbbb945 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030272 Jun 30 12:45:08.441671 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 548/1102] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 30 12:45:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:45:08.944158 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-721e03d6-8a1d-4333-9bc0-e438c426ce7f tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:45:08.944910 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-721e03d6-8a1d-4333-9bc0-e438c426ce7f tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] [instance: d4df4fe8-238b-4558-bb0b-b1635a3eedb5] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:45:08.952983 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-721e03d6-8a1d-4333-9bc0-e438c426ce7f tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:45:08.953543 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-721e03d6-8a1d-4333-9bc0-e438c426ce7f tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:45:08.954494 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-721e03d6-8a1d-4333-9bc0-e438c426ce7f tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:45:08.955183 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-721e03d6-8a1d-4333-9bc0-e438c426ce7f tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:45:09.100906 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-721e03d6-8a1d-4333-9bc0-e438c426ce7f tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b952a9d6bad40c4b2829256bed0e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ebc78f23044b98a13e5e3ebc5dd614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:45:09.109016 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-721e03d6-8a1d-4333-9bc0-e438c426ce7f tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] 10.222.0.57 "GET /compute/v2.1/servers/d4df4fe8-238b-4558-bb0b-b1635a3eedb5" status: 200 len: 1314 microversion: 2.1 time: 0.170594 Jun 30 12:45:09.109633 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 555/1103] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:45:08 2022] GET /compute/v2.1/servers/d4df4fe8-238b-4558-bb0b-b1635a3eedb5 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:45:10.125666 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG dbcounter [-] [124298] Writing DB stats nova_cell0:SELECT=2 {{(pid=124298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:45:10.131141 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-60cd41a3-1356-42c1-a214-4bca1face242 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:45:10.132074 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-60cd41a3-1356-42c1-a214-4bca1face242 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] [instance: d4df4fe8-238b-4558-bb0b-b1635a3eedb5] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:45:10.140386 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-60cd41a3-1356-42c1-a214-4bca1face242 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:45:10.141005 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-60cd41a3-1356-42c1-a214-4bca1face242 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:45:10.141952 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-60cd41a3-1356-42c1-a214-4bca1face242 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:45:10.142498 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-60cd41a3-1356-42c1-a214-4bca1face242 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:45:10.293250 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-60cd41a3-1356-42c1-a214-4bca1face242 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b952a9d6bad40c4b2829256bed0e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ebc78f23044b98a13e5e3ebc5dd614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:45:10.303675 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-60cd41a3-1356-42c1-a214-4bca1face242 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] 10.222.0.57 "GET /compute/v2.1/servers/d4df4fe8-238b-4558-bb0b-b1635a3eedb5" status: 200 len: 1497 microversion: 2.1 time: 0.179943 Jun 30 12:45:10.304240 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 549/1104] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:45:10 2022] GET /compute/v2.1/servers/d4df4fe8-238b-4558-bb0b-b1635a3eedb5 => generated 1497 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:45:10.848672 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-0cdddff2-d5d5-41f8-b170-7f514ea05be2 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:45:10.849189 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-0cdddff2-d5d5-41f8-b170-7f514ea05be2 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] [instance: d4df4fe8-238b-4558-bb0b-b1635a3eedb5] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:45:10.851209 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG dbcounter [-] [124297] Writing DB stats nova_cell0:SELECT=2 {{(pid=124297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:45:10.851877 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG dbcounter [-] [124297] Writing DB stats nova_cell0:SELECT=6 {{(pid=124297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:45:10.858687 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-0cdddff2-d5d5-41f8-b170-7f514ea05be2 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:45:10.859134 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-0cdddff2-d5d5-41f8-b170-7f514ea05be2 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:45:10.860203 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-0cdddff2-d5d5-41f8-b170-7f514ea05be2 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:45:10.860651 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-0cdddff2-d5d5-41f8-b170-7f514ea05be2 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:45:10.886750 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-0cdddff2-d5d5-41f8-b170-7f514ea05be2 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] [instance: d4df4fe8-238b-4558-bb0b-b1635a3eedb5] Going to try to terminate instance {{(pid=124297) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 12:45:10.889582 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG dbcounter [-] [124297] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:45:10.968168 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-0cdddff2-d5d5-41f8-b170-7f514ea05be2 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] 10.222.0.57 "DELETE /compute/v2.1/servers/d4df4fe8-238b-4558-bb0b-b1635a3eedb5" status: 204 len: 0 microversion: 2.1 time: 0.123082 Jun 30 12:45:10.968901 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 556/1105] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 30 12:45:10 2022] DELETE /compute/v2.1/servers/d4df4fe8-238b-4558-bb0b-b1635a3eedb5 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 12:45:10.977555 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-375c79eb-403e-4667-9e46-5af50b12ea41 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:45:10.978200 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-375c79eb-403e-4667-9e46-5af50b12ea41 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] [instance: d4df4fe8-238b-4558-bb0b-b1635a3eedb5] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:45:10.984387 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-375c79eb-403e-4667-9e46-5af50b12ea41 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:45:10.984876 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-375c79eb-403e-4667-9e46-5af50b12ea41 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:45:10.985639 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-375c79eb-403e-4667-9e46-5af50b12ea41 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:45:10.986092 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-375c79eb-403e-4667-9e46-5af50b12ea41 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:45:11.119428 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.policy [None req-375c79eb-403e-4667-9e46-5af50b12ea41 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b952a9d6bad40c4b2829256bed0e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ebc78f23044b98a13e5e3ebc5dd614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124298) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:45:11.127643 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-375c79eb-403e-4667-9e46-5af50b12ea41 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] 10.222.0.57 "GET /compute/v2.1/servers/d4df4fe8-238b-4558-bb0b-b1635a3eedb5" status: 200 len: 1503 microversion: 2.1 time: 0.154005 Jun 30 12:45:11.128256 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 550/1106] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:45:10 2022] GET /compute/v2.1/servers/d4df4fe8-238b-4558-bb0b-b1635a3eedb5 => generated 1503 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:45:12.145577 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-0aed3856-132a-4744-95fb-5b0e0ab9eae6 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:45:12.146276 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-0aed3856-132a-4744-95fb-5b0e0ab9eae6 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] [instance: d4df4fe8-238b-4558-bb0b-b1635a3eedb5] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:45:12.153593 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-0aed3856-132a-4744-95fb-5b0e0ab9eae6 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:45:12.154043 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-0aed3856-132a-4744-95fb-5b0e0ab9eae6 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:45:12.154811 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-0aed3856-132a-4744-95fb-5b0e0ab9eae6 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:45:12.155253 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-0aed3856-132a-4744-95fb-5b0e0ab9eae6 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:45:12.297773 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-0aed3856-132a-4744-95fb-5b0e0ab9eae6 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b952a9d6bad40c4b2829256bed0e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ebc78f23044b98a13e5e3ebc5dd614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:45:12.305685 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-0aed3856-132a-4744-95fb-5b0e0ab9eae6 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] 10.222.0.57 "GET /compute/v2.1/servers/d4df4fe8-238b-4558-bb0b-b1635a3eedb5" status: 200 len: 1503 microversion: 2.1 time: 0.164540 Jun 30 12:45:12.306257 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 557/1107] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:45:12 2022] GET /compute/v2.1/servers/d4df4fe8-238b-4558-bb0b-b1635a3eedb5 => generated 1503 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:45:12.897372 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [req-285cb729-aada-41ec-9918-9ebb34248362 req-c2954ead-047d-4aa1-abe9-10483121a1d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4df4fe8-238b-4558-bb0b-b1635a3eedb5", "name": "network-vif-deleted", "tag": "39fd4680-7535-4ad6-8535-3453265bbd86"}]} {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:45:12.906762 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [req-285cb729-aada-41ec-9918-9ebb34248362 req-c2954ead-047d-4aa1-abe9-10483121a1d9 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:45:12.907202 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [req-285cb729-aada-41ec-9918-9ebb34248362 req-c2954ead-047d-4aa1-abe9-10483121a1d9 service nova] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:45:12.918564 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.compute.server_external_events [req-285cb729-aada-41ec-9918-9ebb34248362 req-c2954ead-047d-4aa1-abe9-10483121a1d9 service nova] Creating event network-vif-deleted:39fd4680-7535-4ad6-8535-3453265bbd86 for instance d4df4fe8-238b-4558-bb0b-b1635a3eedb5 on hv-cinder-84614 Jun 30 12:45:12.923393 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [req-285cb729-aada-41ec-9918-9ebb34248362 req-c2954ead-047d-4aa1-abe9-10483121a1d9 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029809 Jun 30 12:45:12.923986 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 551/1108] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 30 12:45:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:45:13.323262 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.api.openstack.wsgi [None req-fdefcbf9-437f-4369-aaba-97d4e57b5d54 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Calling method '>' {{(pid=124297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:45:13.323875 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.compute.api [None req-fdefcbf9-437f-4369-aaba-97d4e57b5d54 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] [instance: d4df4fe8-238b-4558-bb0b-b1635a3eedb5] Fetching instance by UUID {{(pid=124297) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:45:13.330874 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-fdefcbf9-437f-4369-aaba-97d4e57b5d54 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:45:13.331471 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-fdefcbf9-437f-4369-aaba-97d4e57b5d54 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:45:13.332365 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-fdefcbf9-437f-4369-aaba-97d4e57b5d54 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:45:13.332878 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-fdefcbf9-437f-4369-aaba-97d4e57b5d54 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:45:13.368085 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-fdefcbf9-437f-4369-aaba-97d4e57b5d54 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:45:13.368544 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG oslo_concurrency.lockutils [None req-fdefcbf9-437f-4369-aaba-97d4e57b5d54 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:45:13.369201 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.objects.instance [None req-fdefcbf9-437f-4369-aaba-97d4e57b5d54 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lazy-loading 'fault' on Instance uuid d4df4fe8-238b-4558-bb0b-b1635a3eedb5 {{(pid=124297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 12:45:13.416193 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: DEBUG nova.policy [None req-fdefcbf9-437f-4369-aaba-97d4e57b5d54 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b952a9d6bad40c4b2829256bed0e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ebc78f23044b98a13e5e3ebc5dd614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124297) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 12:45:13.424232 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO nova.api.openstack.requestlog [None req-fdefcbf9-437f-4369-aaba-97d4e57b5d54 tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] 10.222.0.57 "GET /compute/v2.1/servers/d4df4fe8-238b-4558-bb0b-b1635a3eedb5" status: 200 len: 1304 microversion: 2.1 time: 0.105033 Jun 30 12:45:13.424906 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: [pid: 124297|app: 0|req: 558/1109] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:45:13 2022] GET /compute/v2.1/servers/d4df4fe8-238b-4558-bb0b-b1635a3eedb5 => generated 1304 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:45:14.448261 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-d13f66fd-dbd0-4352-b899-8018070f1f3b tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Calling method '>' {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:45:14.449434 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.compute.api [None req-d13f66fd-dbd0-4352-b899-8018070f1f3b tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] [instance: d4df4fe8-238b-4558-bb0b-b1635a3eedb5] Fetching instance by UUID {{(pid=124298) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 12:45:14.452521 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG dbcounter [-] [124298] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=124298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:45:14.461791 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-d13f66fd-dbd0-4352-b899-8018070f1f3b tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:45:14.462227 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-d13f66fd-dbd0-4352-b899-8018070f1f3b tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:45:14.462990 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-d13f66fd-dbd0-4352-b899-8018070f1f3b tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:45:14.463415 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG oslo_concurrency.lockutils [None req-d13f66fd-dbd0-4352-b899-8018070f1f3b tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Lock "3542a1b9-19e7-4045-862a-b91b9d20394c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:45:14.466667 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG dbcounter [-] [124298] Writing DB stats nova_cell1:SELECT=75 {{(pid=124298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:45:14.481483 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.wsgi [None req-d13f66fd-dbd0-4352-b899-8018070f1f3b tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] HTTP exception thrown: Instance d4df4fe8-238b-4558-bb0b-b1635a3eedb5 could not be found. Jun 30 12:45:14.483118 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-d13f66fd-dbd0-4352-b899-8018070f1f3b tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Request method failure captured: Jun 30 12:45:14.483118 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: request: GET /compute/v2.1/servers/d4df4fe8-238b-4558-bb0b-b1635a3eedb5 HTTP/1.1 Jun 30 12:45:14.483118 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Accept: application/json Jun 30 12:45:14.483118 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Accept-Encoding: identity Jun 30 12:45:14.483118 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Connection: close Jun 30 12:45:14.483118 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Content-Length: 0 Jun 30 12:45:14.483118 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Content-Type: application/json Jun 30 12:45:14.483118 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Host: 10.222.0.57 Jun 30 12:45:14.483118 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Openstack-System-Scope: None Jun 30 12:45:14.483118 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: User-Agent: python-urllib3/1.26.9 Jun 30 12:45:14.483118 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Auth-Token: gAAAAABivZq5fe03G8DKrrqtw1aO0N-LlURcIN6rj20bs9iMNCkqlRV3Mgc0mkww0dOGUsvqsI2RJikM9raKN0Rz3jAQ_3Jm17m8W9lb_clCjttms8NB6t67aZPMAAJdgRTxYrO7rftEqydIxgxzrQTQQC5L10HQCYRahkB2XahHF5x4pelzcFQ Jun 30 12:45:14.483118 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Domain-Id: None Jun 30 12:45:14.483118 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Domain-Name: None Jun 30 12:45:14.483118 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Identity-Status: Confirmed Jun 30 12:45:14.483118 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Is-Admin-Project: True Jun 30 12:45:14.483118 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Domain-Id: default Jun 30 12:45:14.483118 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Domain-Name: Default Jun 30 12:45:14.483118 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Id: b9ebc78f23044b98a13e5e3ebc5dd614 Jun 30 12:45:14.483118 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Project-Name: tempest-VolumesActionsTest-593780940 Jun 30 12:45:14.483118 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Role: member,reader Jun 30 12:45:14.483118 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Roles: member,reader Jun 30 12:45:14.484671 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/b9ebc78f23044b98a13e5e3ebc5dd614"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b9ebc78f23044b98a13e5e3ebc5dd614"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_b9ebc78f23044b98a13e5e3ebc5dd614", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b9ebc78f23044b98a13e5e3ebc5dd614"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 30 12:45:14.484671 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant: tempest-VolumesActionsTest-593780940 Jun 30 12:45:14.484671 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant-Id: b9ebc78f23044b98a13e5e3ebc5dd614 Jun 30 12:45:14.484671 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-Tenant-Name: tempest-VolumesActionsTest-593780940 Jun 30 12:45:14.484671 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User: tempest-VolumesActionsTest-593780940-project Jun 30 12:45:14.484671 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Domain-Id: default Jun 30 12:45:14.484671 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Domain-Name: Default Jun 30 12:45:14.484671 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Id: 6b952a9d6bad40c4b2829256bed0e017 Jun 30 12:45:14.484671 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: X-User-Name: tempest-VolumesActionsTest-593780940-project Jun 30 12:45:14.484671 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: method: > Jun 30 12:45:14.484671 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: exception: Instance d4df4fe8-238b-4558-bb0b-b1635a3eedb5 could not be found. Jun 30 12:45:14.484671 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: action_args: {'id': 'd4df4fe8-238b-4558-bb0b-b1635a3eedb5'} Jun 30 12:45:14.485637 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: {{(pid=124298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 12:45:14.485637 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:45:14.485637 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 12:45:14.485637 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 12:45:14.485637 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 12:45:14.485637 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 12:45:14.485637 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 12:45:14.485637 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 12:45:14.485637 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 12:45:14.485637 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 12:45:14.485637 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4df4fe8-238b-4558-bb0b-b1635a3eedb5 could not be found. Jun 30 12:45:14.485637 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:45:14.485637 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:45:14.485637 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:45:14.485637 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:45:14.485637 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:45:14.485637 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:45:14.485637 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 12:45:14.485637 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 12:45:14.485637 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 12:45:14.487170 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 12:45:14.487170 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 12:45:14.487170 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 12:45:14.487170 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 12:45:14.487170 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 12:45:14.487170 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 12:45:14.487170 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 12:45:14.487170 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4df4fe8-238b-4558-bb0b-b1635a3eedb5 could not be found. Jun 30 12:45:14.487170 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:45:14.487170 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:45:14.487170 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:45:14.487170 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:45:14.487170 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:45:14.487170 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:45:14.487170 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 12:45:14.487170 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 12:45:14.487170 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4df4fe8-238b-4558-bb0b-b1635a3eedb5 could not be found. Jun 30 12:45:14.487170 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: ERROR nova.api.openstack.wsgi Jun 30 12:45:14.488707 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: DEBUG nova.api.openstack.wsgi [None req-d13f66fd-dbd0-4352-b899-8018070f1f3b tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] Returning 404 to user: Instance d4df4fe8-238b-4558-bb0b-b1635a3eedb5 could not be found. {{(pid=124298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 12:45:14.488707 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO nova.api.openstack.requestlog [None req-d13f66fd-dbd0-4352-b899-8018070f1f3b tempest-VolumesActionsTest-593780940 tempest-VolumesActionsTest-593780940-project] 10.222.0.57 "GET /compute/v2.1/servers/d4df4fe8-238b-4558-bb0b-b1635a3eedb5" status: 404 len: 111 microversion: 2.1 time: 0.045012 Jun 30 12:45:14.488707 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: [pid: 124298|app: 0|req: 552/1110] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 30 12:45:14 2022] GET /compute/v2.1/servers/d4df4fe8-238b-4558-bb0b-b1635a3eedb5 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 12:48:07.706964 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 12:48:07.707927 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Thu Jun 30 12:48:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 12:48:30.511180 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 12:48:30.512162 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Thu Jun 30 12:48:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 12:48:30.653812 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 12:48:30.654767 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Thu Jun 30 12:48:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 12:49:38.071963 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 12:49:38.072800 dv-cinder-846146-5-iscsi devstack@n-api.service[124297]: Thu Jun 30 12:49:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 12:49:45.775598 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 12:49:45.776533 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Thu Jun 30 12:49:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 12:49:55.824527 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 12:49:55.825715 dv-cinder-846146-5-iscsi devstack@n-api.service[124298]: Thu Jun 30 12:49:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!